Nov 05 11:46:40 devstack cinder-volume[76100]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 11:46:40 devstack cinder-volume[76100]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:46:40 devstack cinder-volume[76100]: we strongly recommend against using it for new projects.
Nov 05 11:46:40 devstack cinder-volume[76100]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:46:40 devstack cinder-volume[76100]: framework.  For more detail see
Nov 05 11:46:40 devstack cinder-volume[76100]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:46:40 devstack cinder-volume[76100]:   import eventlet  # noqa
Nov 05 11:46:43 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:46:43 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:46:43 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:46:44 devstack cinder-volume[76100]: INFO dbcounter [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Registered counter for database cinder
Nov 05 11:46:44 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG dbcounter [-] [76100] Writer thread running {{(pid=76100) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO cinder.rpc [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO cinder.rpc [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO cinder.volume.manager [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Determined volume DB was empty at startup.
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG cinder.volume.manager [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76100) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO cinder.volume.manager [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 11:46:45 devstack cinder-volume[76100]: WARNING stevedore.named [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:46:45 devstack cinder-volume[76100]: WARNING castellan.key_manager [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:46:45 devstack cinder-volume[76100]: WARNING cinder.keymgr.conf_key_mgr [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG cinder.volume.drivers.lvm [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76100) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_concurrency.processutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_concurrency.processutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=76100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO cinder.rpc [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO cinder.rpc [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 05 11:46:45 devstack cinder-volume[76100]: WARNING stevedore.named [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:46:45 devstack cinder-volume[76100]: WARNING castellan.key_manager [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO cinder.volume.manager [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:45 devstack cinder-volume[76100]: INFO oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Starting 1 workers
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Started child 76431 {{(pid=76100) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Full set of CONF: {{(pid=76100) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] ******************************************************************************** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Configuration options gathered from: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] ================================================================================ {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] allow_availability_zone_fallback = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] allow_compression_on_image_upload = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] allowed_direct_url_schemes     = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76431]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] api_rate_limit                 = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] auth_strategy                  = keystone {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] az_cache_duration              = 3600 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_availability_zone      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_host                   = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_name                   = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_stats_polling_interval = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backup_api_class               = cinder.backup.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backup_name_template           = backup-%s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backup_use_same_host           = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backup_use_temp_snapshot       = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] chap_password                  = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] chap_username                  =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_internal_tenant_project_id = 8ecba4e8495a48b1b8bea1df4d1fe903 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_internal_tenant_user_id = 2ecbc35afceb482abea9efe4d9258dd7 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cloned_volume_same_az          = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cluster                        = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] compression_format             = gzip {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] config_dir                     = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] config_source                  = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] control_exchange               = openstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] debug                          = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] default_availability_zone      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] default_group_type             = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] default_volume_type            = lvmdriver-1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] disk_geometry                  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] driver_client_cert             = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] driver_client_cert_key         = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] driver_data_namespace          = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] driver_ssl_cert_path           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] driver_ssl_cert_verify         = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] driver_use_ssl                 = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] enable_force_upload            = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] enable_new_services            = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] enable_unsupported_driver      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] enforce_multipath_for_image_xfer = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] filter_function                = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_api_insecure            = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_api_servers             = ['http://192.168.122.28/image'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_api_ssl_compression     = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_ca_certificates_file    = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_certfile                = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_keyfile                 = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_num_retries             = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance_request_timeout         = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] goodness_function              = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] graceful_shutdown_timeout      = 5 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] group_api_class                = cinder.group.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] host                           = devstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_compress_on_upload       = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_conversion_address_space_limit = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_conversion_cpu_limit     = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_conversion_disable       = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_introspection_address_space_limit = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_introspection_cpu_limit  = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_upload_use_cinder_backend = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_upload_use_internal_tenant = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_volume_cache_enabled     = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_volume_cache_max_count   = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] image_volume_cache_max_size_gb = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] init_host_max_objects_retrieval = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] iscsi_target_flags             =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76431]: INFO cinder.volume.manager [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] iscsi_write_cache              = on {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] iser_helper                    = tgtadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] iser_ip_address                = 192.168.122.28 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] iser_port                      = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_color                      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_config_append              = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_dir                        = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_file                       = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_options                    = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_rotate_interval            = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_rotate_interval_type       = days {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] log_rotation_type              = none {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] max_age                        = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] max_logfile_count              = 30 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] max_logfile_size_mb            = 200 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] max_over_subscription_ratio    = 20.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] message_reap_interval          = 86400 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] message_ttl                    = 2592000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] migration_create_volume_timeout_secs = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] monkey_patch                   = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] monkey_patch_modules           = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] my_ip                          = 192.168.122.28 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] no_snapshot_gb_quota           = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] num_iser_scan_tries            = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] num_shell_tries                = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] num_volume_device_scan_tries   = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] nvmeof_conn_info_version       = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] nvmet_ns_id                    = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] nvmet_port_id                  = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] osapi_max_limit                = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] osapi_volume_ext_list          = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] osapi_volume_listen_port       = 8776 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] osapi_volume_use_ssl           = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] osapi_volume_workers           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] per_volume_size_limit          = -1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] periodic_fuzzy_delay           = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] periodic_interval              = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] public_endpoint                = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] publish_errors                 = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] quota_backup_gigabytes         = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] quota_backups                  = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] quota_gigabytes                = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] quota_groups                   = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] quota_snapshots                = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] quota_volumes                  = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] rate_limit_burst               = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] rate_limit_except_level        = CRITICAL {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] rate_limit_interval            = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] reinit_driver_count            = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:45 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] replication_device             = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] report_discard_supported       = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] report_interval                = 120 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] reservation_clean_interval     = 86400 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] reservation_expire             = 86400 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] reserved_image_namespaces      = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] reserved_percentage            = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] rpc_response_timeout           = 120 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] run_external_periodic_tasks    = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] scst_target_driver             = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] scst_target_iqn_name           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_down_time              = 720 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] shell_completion               = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] snapshot_name_template         = snapshot-%s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] snapshot_same_host             = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] split_loggers                  = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] state_path                     = /opt/stack/data/cinder {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] storage_availability_zone      = nova {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] storage_protocol               = iSCSI {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] syslog_log_facility            = LOG_USER {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] target_helper                  = lioadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] target_ip_address              = 192.168.122.28 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] target_port                    = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] target_protocol                = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] target_secondary_ip_addresses  = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] trace_flags                    = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] transport_url                  = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] until_refresh                  = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] use_chap_auth                  = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] use_default_quota_class        = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] use_journal                    = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] use_json                       = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] use_multipath_for_image_xfer   = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] use_stderr                     = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] use_syslog                     = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] verify_glance_signatures       = enabled {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_api_class               = cinder.volume.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_backend_name            = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_clear                   = zero {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_clear_ionice            = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_clear_size              = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_copy_bps_limit          = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_dd_blocksize            = 1M {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_name_template           = volume-%s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_service_inithost_offload = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volume_usage_audit_period      = month {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] zoning_mode                    = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_concurrency.disable_process_locking = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.auth_section = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.auth_type   = password {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.auth_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.cache       = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.certfile    = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.include_service_catalog = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.insecure    = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.interface   = public {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.keyfile     = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_password = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcache_username = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.region_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.service_type = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.backend                  = dogpile.cache.null {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.backend_argument         = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.backend_expiration_time  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.config_prefix            = cache.oslo {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.debug_cache_backend      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.enable_retry_client      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.enable_socket_keepalive  = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.enabled                  = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.expiration_time          = 600 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.hashclient_retry_attempts = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.memcache_dead_retry      = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.memcache_sasl_enabled    = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.password                 = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.proxies                  = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.redis_db                 = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.redis_server             = localhost:6379 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.retry_attempts           = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.retry_delay              = 0.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.socket_keepalive_count   = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.socket_keepalive_idle    = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.socket_keepalive_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.socket_timeout           = 1.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.tls_allowed_ciphers      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.tls_cafile               = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.tls_certfile             = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.tls_enabled              = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.tls_keyfile              = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cache.username                 = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] coordination.backend_url       = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.asyncio_connection    = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.asyncio_slave_connection = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.backend               = sqlalchemy {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.connection            = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack sudo[76469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.connection_debug      = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.connection_parameters =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.connection_recycle_time = 3600 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.connection_trace      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.db_inc_retry_interval = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.db_max_retries        = 20 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.db_max_retry_interval = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.db_retry_interval     = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.max_overflow          = 50 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.max_pool_size         = 5 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.max_retries           = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.mysql_wsrep_sync_wait = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.pool_timeout          = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack sudo[76469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.retry_interval        = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.slave_connection      = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.sqlite_synchronous    = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.synchronous_reader    = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] database.use_db_reconnect      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_tracing.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.connection_string     = messaging:// {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.enabled               = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.es_doc_type           = notification {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.es_scroll_size        = 10000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.es_scroll_time        = 2m {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.filter_error_trace    = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.hmac_keys             = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.sentinel_service_name = mymaster {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.socket_timeout        = 0.1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.trace_requests        = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler.trace_sqlalchemy      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler_jaeger.process_tags   = {} {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler_jaeger.service_name_prefix = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] profiler_otlp.service_name_prefix = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.enforce_new_defaults = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.policy_default_rule = default {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] privsep_osbrick.group          = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] privsep_osbrick.helper_command = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] privsep_osbrick.user           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_sys_admin.group         = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_sys_admin.helper_command = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] cinder_sys_admin.user          = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.auth_section      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.auth_type         = password {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.cafile            = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.certfile          = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.collect_timing    = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.insecure          = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.keyfile           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.send_service_user_token = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.split_loggers     = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.timeout           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.tls_ciphers       = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] service_user.tls_min_version   = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.auth_section            = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.auth_type               = password {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.certfile                = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.collect_timing          = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.insecure                = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.keyfile                 = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.region_name             = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.split_loggers           = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.timeout                 = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.tls_ciphers             = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] glance.tls_min_version         = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.backend_availability_zone = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.chap_password = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.chap_username =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.disk_geometry = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.driver_client_cert = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.driver_client_cert_key = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.driver_data_namespace = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.driver_use_ssl = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.extra_capabilities = {} {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.filter_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.goodness_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.iscsi_target_flags =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.iscsi_write_cache = on {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.iser_port     = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.lvm_share_target = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.lvm_type      = auto {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.num_shell_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.replication_device = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.report_discard_supported = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.reserved_percentage = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.target_helper = tgtadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.target_port   = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.target_protocol = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.trace_flags   = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.unique_fqdn_network = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.use_chap_auth = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_backend_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_clear  = zero {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_clear_ionice = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_clear_size = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_reports.file_event_handler = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_reports.log_dir           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.backend_host       = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.chap_password      = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.chap_username      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.disk_geometry      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.driver_client_cert = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.extra_capabilities = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.filter_function    = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.goodness_function  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.iser_helper        = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.iser_port          = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.lvm_type           = auto {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.replication_device = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.report_discard_supported = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.reserved_percentage = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.scst_target_driver = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.storage_protocol   = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.target_ip_address  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.target_port        = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.trace_flags        = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_clear       = zero {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] lvmdriver-1.volumes_dir        = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_notifications.driver = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_notifications.retry = -1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] key_manager.fixed_key          = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.barbican_api_version  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.barbican_endpoint     = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.barbican_endpoint_type = public {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.barbican_region_name  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.cafile                = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.certfile              = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.collect_timing        = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.insecure              = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.keyfile               = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.number_of_retries     = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.retry_delay           = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.send_service_user_token = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.split_loggers         = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.timeout               = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.tls_ciphers           = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.tls_min_version       = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.verify_ssl            = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican.verify_ssl_path       = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.auth_section = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.auth_type = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.cafile   = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.collect_timing = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.keyfile  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.split_loggers = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.timeout  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.tls_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] barbican_service_user.tls_min_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.approle_role_id          = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.approle_secret_id        = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.auth_method              = approle {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.auth_path                = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.kv_mountpoint            = secret {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.kv_path                  = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.kv_version               = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.namespace                = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.root_token_id            = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.ssl_ca_crt_file          = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.timeout                  = 60.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.token_file               = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.token_role               = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.use_ssl                  = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:46 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] ******************************************************************************** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 11:46:46 devstack sudo[76469]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.377s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack sudo[76584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:46 devstack sudo[76584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:46 devstack sudo[76584]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.321s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 11:46:46 devstack cinder-volume[76431]: INFO cinder.brick.local_dev.lvm [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack sudo[76685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:46 devstack sudo[76685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:47 devstack sudo[76685]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:47 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:47 devstack cinder-volume[76431]: DEBUG cinder.brick.local_dev.lvm [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76431) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 11:46:47 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:47 devstack sudo[76755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:47 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:48 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.388s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:48 devstack sudo[77026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:48 devstack sudo[77026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:48 devstack sudo[77026]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:48 devstack sudo[77087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 11:46:48 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:49 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:49 devstack sudo[77090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:49 devstack sudo[77090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:49 devstack sudo[77090]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:49 devstack sudo[77093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:49 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:49 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:49 devstack sudo[77096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:49 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:49 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:49 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:49 devstack sudo[77105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:49 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:50 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack sudo[77109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:50 devstack sudo[77109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:50 devstack sudo[77109]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76431]: INFO cinder.volume.drivers.lvm [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack sudo[77113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:50 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:50 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG cinder.volume.drivers.lvm [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Updating volume stats {{(pid=76431) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack sudo[77116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:50 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:50 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack sudo[77121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:50 devstack sudo[77121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:51 devstack sudo[77121]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:51 devstack sudo[77124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:51 devstack sudo[77124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:51 devstack sudo[77124]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:51 devstack sudo[77127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:51 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:51 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:51 devstack cinder-volume[76431]: INFO cinder.volume.driver [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG cinder.volume.driver [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76431) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG oslo_db.sqlalchemy.engines [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG dbcounter [-] [76431] Writer thread running {{(pid=76431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG cinder.db.api [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Building query based on filter {{(pid=76431) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG cinder.image.image_utils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76431) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 11:46:51 devstack cinder-volume[76431]: INFO cinder.keymgr.migration [None req-a8ba55d6-4c9a-4cc8-a82c-a90e9106f014 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG cinder.volume.drivers.lvm [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Updating volume stats {{(pid=76431) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:46:51 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:51 devstack sudo[77130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:51 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:52 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:52 devstack sudo[77133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:52 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:52 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:52 devstack sudo[77139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:52 devstack sudo[77139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:52 devstack sudo[77139]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:52 devstack sudo[77143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:52 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:52 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG cinder.manager [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Notifying Schedulers of capabilities ... {{(pid=76431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:46:52 devstack cinder-volume[76431]: INFO cinder.volume.manager [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Driver initialization completed successfully.
Nov 05 11:46:52 devstack cinder-volume[76431]: INFO cinder.manager [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Initiating service 2 cleanup
Nov 05 11:46:52 devstack cinder-volume[76431]: INFO cinder.manager [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Service 2 cleanup completed.
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG cinder.service [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Creating RPC server for service cinder-volume {{(pid=76431) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 11:46:52 devstack cinder-volume[76431]: DEBUG cinder.service [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76431) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 11:46:53 devstack cinder-volume[76431]: INFO cinder.volume.manager [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG cinder.volume.drivers.lvm [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Updating volume stats {{(pid=76431) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:53 devstack sudo[77149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:53 devstack sudo[77149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:53 devstack sudo[77149]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:53 devstack sudo[77152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:53 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:53 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:53 devstack sudo[77155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:53 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:53 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:53 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:53 devstack sudo[77160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:53 devstack sudo[77160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:54 devstack sudo[77160]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:54 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:54 devstack cinder-volume[76431]: INFO cinder.volume.manager [None req-217ba2e2-6c3f-41ab-9937-444baa2c69ca None None] Driver post RPC initialization completed successfully.
Nov 05 11:46:55 devstack cinder-volume[76100]: DEBUG dbcounter [-] [76100] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76100) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:47:00 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager._thread_info {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:47:00 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread count: 6 {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:47:00 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread info: [<_MainThread(MainThread, started 136921509519488)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136921395199552)>, <Thread(Thread-3 (stat_writer), started daemon 136921398005440)>, <Thread(Rabbit-heartbeat, started daemon 136921394515264)>, <Thread(Thread-5 (_runner), started daemon 136921394581056)>, <Thread(Thread-7 (_runner), started daemon 136921394582528)>] {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:47:04 devstack cinder-volume[76431]: DEBUG dbcounter [-] [76431] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:47:04 devstack cinder-volume[76431]: DEBUG dbcounter [-] [76431] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:48:00 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:48:00 devstack cinder-volume[76431]: DEBUG cinder.volume.drivers.lvm [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Updating volume stats {{(pid=76431) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:48:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:00 devstack sudo[79399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:48:00 devstack sudo[79399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:00 devstack sudo[79399]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:00 devstack sudo[79402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:48:00 devstack sudo[79402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:00 devstack sudo[79402]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:00 devstack sudo[79405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:48:00 devstack sudo[79405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:01 devstack sudo[79405]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:01 devstack sudo[79408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:48:01 devstack sudo[79408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:01 devstack sudo[79408]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:01 devstack cinder-volume[76431]: DEBUG cinder.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Notifying Schedulers of capabilities ... {{(pid=76431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:48:01 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager._thread_info {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:48:01 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread count: 6 {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:48:01 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread info: [<_MainThread(MainThread, started 136921509519488)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136921395199552)>, <Thread(Thread-3 (stat_writer), started daemon 136921398005440)>, <Thread(Rabbit-heartbeat, started daemon 136921394515264)>, <Thread(Thread-5 (_runner), started daemon 136921394581056)>, <Thread(Thread-7 (_runner), started daemon 136921394582528)>] {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG cinder.volume.drivers.lvm [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Updating volume stats {{(pid=76431) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:00 devstack sudo[82531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:49:00 devstack sudo[82531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:00 devstack sudo[82531]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:00 devstack sudo[82534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:49:00 devstack sudo[82534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:00 devstack sudo[82534]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:00 devstack sudo[82537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:49:00 devstack sudo[82537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:00 devstack sudo[82537]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:01 devstack sudo[82574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:49:01 devstack sudo[82574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:01 devstack sudo[82574]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:01 devstack cinder-volume[76431]: DEBUG cinder.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Notifying Schedulers of capabilities ... {{(pid=76431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:49:01 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager._thread_info {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:49:01 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread count: 6 {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:49:01 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread info: [<_MainThread(MainThread, started 136921509519488)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136921395199552)>, <Thread(Thread-3 (stat_writer), started daemon 136921398005440)>, <Thread(Rabbit-heartbeat, started daemon 136921394515264)>, <Thread(Thread-5 (_runner), started daemon 136921394581056)>, <Thread(Thread-7 (_runner), started daemon 136921394582528)>] {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:49:04 devstack cinder-volume[76431]: DEBUG dbcounter [-] [76431] Writing DB stats cinder:SELECT=1 {{(pid=76431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:49:04 devstack cinder-volume[76431]: DEBUG dbcounter [-] [76431] Writing DB stats cinder:UPDATE=1 {{(pid=76431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG cinder.volume.drivers.lvm [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Updating volume stats {{(pid=76431) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:00 devstack sudo[84647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:50:00 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:00 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:00 devstack sudo[84652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:50:00 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:00 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:00 devstack sudo[84655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:50:00 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:00 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:01 devstack sudo[84658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:50:01 devstack sudo[84658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:01 devstack sudo[84658]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:01 devstack cinder-volume[76431]: DEBUG cinder.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Notifying Schedulers of capabilities ... {{(pid=76431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:50:01 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager._thread_info {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:50:01 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread count: 6 {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:50:01 devstack cinder-volume[76431]: DEBUG cinder.volume.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] thread info: [<_MainThread(MainThread, started 136921509519488)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136921395199552)>, <Thread(Thread-3 (stat_writer), started daemon 136921398005440)>, <Thread(Rabbit-heartbeat, started daemon 136921394515264)>, <Thread(Thread-5 (_runner), started daemon 136921394581056)>, <Thread(Thread-7 (_runner), started daemon 136921394582528)>] {{(pid=76431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:51:00 devstack cinder-volume[76431]: DEBUG oslo_service.periodic_task [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:51:00 devstack cinder-volume[76431]: DEBUG cinder.volume.drivers.lvm [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Updating volume stats {{(pid=76431) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:51:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:00 devstack sudo[85857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:51:00 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:00 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:00 devstack sudo[85860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:51:00 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:00 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:00 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:00 devstack sudo[85864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:51:00 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:00 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:01 devstack sudo[85889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:51:01 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:01 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:01 devstack cinder-volume[76431]: DEBUG oslo_concurrency.processutils [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:01 devstack cinder-volume[76431]: DEBUG cinder.manager [None req-2623b45c-b334-49e3-b9cb-9b63115873a0 None None] Notifying Schedulers of capabilities ... {{(pid=76431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:51:04 devstack cinder-volume[76431]: DEBUG dbcounter [-] [76431] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:51:18 devstack cinder-volume[76100]: INFO oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Caught SIGTERM, stopping children
Nov 05 11:51:18 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Acquiring lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:18 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Acquired lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:18 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Releasing lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:18 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Stop services. {{(pid=76100) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 11:51:18 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Killing children. {{(pid=76100) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 11:51:18 devstack cinder-volume[76100]: INFO oslo_service.backend._eventlet.service [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Waiting on 1 children to exit
Nov 05 11:51:23 devstack cinder-volume[76431]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Nov 05 11:51:23 devstack cinder-volume[86340]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 11:51:23 devstack cinder-volume[86340]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:51:23 devstack cinder-volume[86340]: we strongly recommend against using it for new projects.
Nov 05 11:51:23 devstack cinder-volume[86340]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:51:23 devstack cinder-volume[86340]: framework.  For more detail see
Nov 05 11:51:23 devstack cinder-volume[86340]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:51:23 devstack cinder-volume[86340]:   import eventlet  # noqa
Nov 05 11:51:25 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:25 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:25 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:26 devstack cinder-volume[86340]: INFO dbcounter [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Registered counter for database cinder
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_db.sqlalchemy.engines [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG dbcounter [-] [86340] Writer thread running {{(pid=86340) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:26 devstack cinder-volume[86340]: INFO cinder.rpc [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 11:51:26 devstack cinder-volume[86340]: INFO cinder.rpc [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_db.sqlalchemy.engines [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:26 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Determined volume DB was empty at startup.
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG cinder.volume.manager [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86340) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 11:51:26 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 11:51:26 devstack cinder-volume[86340]: WARNING stevedore.named [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:51:26 devstack cinder-volume[86340]: WARNING castellan.key_manager [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:26 devstack cinder-volume[86340]: WARNING cinder.keymgr.conf_key_mgr [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:26 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_db.sqlalchemy.engines [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:26 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Starting 1 workers
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Started child 86559 {{(pid=86340) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Full set of CONF: {{(pid=86340) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] ******************************************************************************** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Configuration options gathered from: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] ================================================================================ {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] allow_availability_zone_fallback = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] allow_compression_on_image_upload = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] allowed_direct_url_schemes     = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] api_rate_limit                 = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] auth_strategy                  = keystone {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86559]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_availability_zone      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_host                   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_name                   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_stats_polling_interval = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:26 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backup_api_class               = cinder.backup.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backup_name_template           = backup-%s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backup_use_same_host           = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backup_use_temp_snapshot       = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] chap_password                  = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] chap_username                  =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_internal_tenant_project_id = 8ecba4e8495a48b1b8bea1df4d1fe903 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_internal_tenant_user_id = 2ecbc35afceb482abea9efe4d9258dd7 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cluster                        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] compression_format             = gzip {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] compute_api_class              = cinder.compute.nova.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] config_dir                     = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] config_source                  = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] control_exchange               = openstack {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] debug                          = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] default_availability_zone      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] default_group_type             = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] default_volume_type            = QuobyteHD {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] disk_geometry                  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] driver_client_cert             = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] driver_client_cert_key         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] driver_data_namespace          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] driver_ssl_cert_path           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] driver_ssl_cert_verify         = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] driver_use_ssl                 = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] enable_new_services            = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] enable_unsupported_driver      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] enabled_backends               = ['QuobyteHD'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] enforce_multipath_for_image_xfer = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] filter_function                = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_api_insecure            = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_api_servers             = ['http://192.168.122.28/image'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_api_ssl_compression     = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_ca_certificates_file    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_catalog_info            = image:glance:publicURL {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_certfile                = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_keyfile                 = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_num_retries             = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance_request_timeout         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] goodness_function              = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] graceful_shutdown_timeout      = 5 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] group_api_class                = cinder.group.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] host                           = devstack {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_compress_on_upload       = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_conversion_address_space_limit = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_conversion_cpu_limit     = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_conversion_disable       = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_introspection_address_space_limit = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_introspection_cpu_limit  = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_upload_use_cinder_backend = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_upload_use_internal_tenant = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_volume_cache_enabled     = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_volume_cache_max_count   = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] image_volume_cache_max_size_gb = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] init_host_max_objects_retrieval = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] instance_format                = [instance: %(uuid)s]  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] iscsi_target_flags             =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] iscsi_write_cache              = on {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] iser_helper                    = tgtadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] iser_ip_address                = 192.168.122.28 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] iser_port                      = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_color                      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_config_append              = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_dir                        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_file                       = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_options                    = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_rotate_interval            = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_rotate_interval_type       = days {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] log_rotation_type              = none {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] max_age                        = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] max_logfile_count              = 30 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] max_logfile_size_mb            = 200 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] max_over_subscription_ratio    = 20.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] message_reap_interval          = 86400 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] message_ttl                    = 2592000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] migration_create_volume_timeout_secs = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] monkey_patch                   = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] monkey_patch_modules           = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] my_ip                          = 192.168.122.28 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] no_snapshot_gb_quota           = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] num_iser_scan_tries            = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] num_shell_tries                = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] num_volume_device_scan_tries   = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] nvmeof_conn_info_version       = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] nvmet_ns_id                    = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] nvmet_port_id                  = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] osapi_max_limit                = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] osapi_volume_ext_list          = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] osapi_volume_listen_port       = 8776 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] osapi_volume_use_ssl           = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] osapi_volume_workers           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] per_volume_size_limit          = -1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] periodic_fuzzy_delay           = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] periodic_interval              = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] public_endpoint                = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] publish_errors                 = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.remotefs [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86559) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] quota_backup_gigabytes         = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] quota_backups                  = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] quota_gigabytes                = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] quota_groups                   = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] quota_snapshots                = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] quota_volumes                  = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] rate_limit_burst               = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] rate_limit_except_level        = CRITICAL {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] rate_limit_interval            = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] reinit_driver_count            = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] replication_device             = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] report_discard_supported       = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] report_interval                = 120 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] reservation_clean_interval     = 86400 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] reservation_expire             = 86400 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] reserved_image_namespaces      = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] reserved_percentage            = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] rpc_response_timeout           = 120 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] run_external_periodic_tasks    = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] scst_target_driver             = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] scst_target_iqn_name           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_down_time              = 720 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] shell_completion               = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] snapshot_name_template         = snapshot-%s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] split_loggers                  = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] state_path                     = /opt/stack/data/cinder {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] storage_availability_zone      = nova {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] storage_protocol               = iSCSI {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] syslog_log_facility            = LOG_USER {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] target_helper                  = lioadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] target_ip_address              = 192.168.122.28 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] target_port                    = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] target_protocol                = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] target_secondary_ip_addresses  = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] trace_flags                    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] transport_url                  = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] until_refresh                  = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] use_chap_auth                  = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] use_default_quota_class        = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] use_journal                    = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] use_json                       = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] use_multipath_for_image_xfer   = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] use_stderr                     = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] use_syslog                     = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] verify_glance_signatures       = enabled {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_api_class               = cinder.volume.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_backend_name            = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_clear                   = zero {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_clear_ionice            = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_clear_size              = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_copy_bps_limit          = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_dd_blocksize            = 1M {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_name_template           = volume-%s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_service_inithost_offload = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volume_usage_audit_period      = month {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] zoning_mode                    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_concurrency.disable_process_locking = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.auth_section = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.auth_type   = password {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.auth_version = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.cache       = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.certfile    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.include_service_catalog = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.insecure    = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.interface   = public {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.keyfile     = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcache_username = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.region_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.service_type = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.backend                  = dogpile.cache.null {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.backend_argument         = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.backend_expiration_time  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.config_prefix            = cache.oslo {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.debug_cache_backend      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.enable_retry_client      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.enable_socket_keepalive  = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.enabled                  = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.expiration_time          = 600 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.hashclient_retry_attempts = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.memcache_dead_retry      = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.memcache_pool_maxsize    = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.memcache_sasl_enabled    = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.password                 = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.proxies                  = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.redis_db                 = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.redis_server             = localhost:6379 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.retry_attempts           = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.retry_delay              = 0.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.socket_keepalive_count   = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.socket_keepalive_idle    = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.socket_keepalive_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.socket_timeout           = 1.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.tls_allowed_ciphers      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.tls_cafile               = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.tls_certfile             = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.tls_enabled              = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.tls_keyfile              = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cache.username                 = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] coordination.backend_url       = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.asyncio_connection    = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.asyncio_slave_connection = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.backend               = sqlalchemy {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.connection            = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.connection_debug      = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.connection_parameters =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.connection_recycle_time = 3600 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.connection_trace      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.db_inc_retry_interval = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.db_max_retries        = 20 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.db_max_retry_interval = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.db_retry_interval     = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.max_overflow          = 50 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.max_pool_size         = 5 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.max_retries           = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.mysql_wsrep_sync_wait = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.pool_timeout          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.retry_interval        = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.slave_connection      = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.sqlite_synchronous    = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.synchronous_reader    = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] database.use_db_reconnect      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_tracing.insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.connection_string     = messaging:// {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.enabled               = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.es_doc_type           = notification {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.es_scroll_size        = 10000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.es_scroll_time        = 2m {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.filter_error_trace    = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.hmac_keys             = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.sentinel_service_name = mymaster {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.socket_timeout        = 0.1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.trace_requests        = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler.trace_sqlalchemy      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler_jaeger.process_tags   = {} {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler_jaeger.service_name_prefix = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] profiler_otlp.service_name_prefix = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.enforce_new_defaults = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.policy_default_rule = default {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.policy_file        = policy.yaml {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] privsep_osbrick.group          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] privsep_osbrick.helper_command = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] privsep_osbrick.user           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_sys_admin.group         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_sys_admin.helper_command = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] cinder_sys_admin.user          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.auth_section      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.auth_type         = password {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.cafile            = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.certfile          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.collect_timing    = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.insecure          = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.keyfile           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.send_service_user_token = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.split_loggers     = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.timeout           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.tls_ciphers       = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] service_user.tls_min_version   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.auth_section            = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.auth_type               = password {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.certfile                = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.collect_timing          = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.insecure                = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86559) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.keyfile                 = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.region_name             = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.split_loggers           = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.timeout                 = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.tls_ciphers             = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] glance.tls_min_version         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.backend_availability_zone = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.chap_password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86559]: WARNING cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.chap_username =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86559]: WARNING cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.disk_geometry = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.driver_client_cert = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.driver_client_cert_key = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Running cmd (subprocess): mount.quobyte {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.driver_data_namespace = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.driver_use_ssl = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.extra_capabilities = {} {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.filter_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.goodness_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.iscsi_target_flags =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.iscsi_write_cache = on {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.iser_helper   = tgtadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.iser_port     = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_host      =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_login     = admin {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_mount_options = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_password  = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_private_key =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_share_path =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.num_shell_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.quobyte_volume_url = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.replication_device = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.report_discard_supported = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.reserved_percentage = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.target_helper = tgtadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.target_port   = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.target_protocol = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.trace_flags   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.unique_fqdn_network = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.use_chap_auth = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_backend_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_clear  = zero {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_clear_ionice = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_clear_size = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_reports.file_event_handler = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_reports.log_dir           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.backend_availability_zone = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.backend_host         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.chap_password        = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.chap_username        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.chiscsi_conf         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.disk_geometry        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.driver_client_cert   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.driver_data_namespace = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.driver_use_ssl       = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.extra_capabilities   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.filter_function      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.goodness_function    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.iser_helper          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.iser_ip_address      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.iser_port            = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.iser_target_prefix   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_host             = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_login            = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_mount_options    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_password         = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_private_key      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_share_path       = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_ssh_port         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.num_shell_tries      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.nvmet_port_id        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.replication_device   = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.report_discard_supported = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.reserved_percentage  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.scst_target_driver   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.storage_protocol     = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.target_helper        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.target_ip_address    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.target_port          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.target_prefix        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.target_protocol      = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.trace_flags          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.use_chap_auth        = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_clear         = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_clear_size    = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] QuobyteHD.volumes_dir          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.ssl      = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_notifications.driver = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_notifications.retry = -1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] key_manager.fixed_key          = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.barbican_api_version  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.barbican_endpoint     = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.barbican_endpoint_type = public {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.barbican_region_name  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.cafile                = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.certfile              = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.collect_timing        = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.insecure              = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.keyfile               = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.number_of_retries     = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.retry_delay           = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.send_service_user_token = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.split_loggers         = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.timeout               = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.tls_ciphers           = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.tls_min_version       = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.verify_ssl            = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican.verify_ssl_path       = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.auth_section = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.auth_type = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.cafile   = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.collect_timing = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.keyfile  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.split_loggers = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.timeout  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.tls_ciphers = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] barbican_service_user.tls_min_version = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.approle_role_id          = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.approle_secret_id        = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.auth_method              = approle {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.auth_path                = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.kv_mountpoint            = secret {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.kv_path                  = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.kv_version               = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.namespace                = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.root_token_id            = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.ssl_ca_crt_file          = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.timeout                  = 60.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.token_file               = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.token_role               = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.use_ssl                  = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:27 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] ******************************************************************************** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 11:51:27 devstack quobyte-client[86564]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 11:51:27 devstack quobyte-client[86564]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=86559) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:27 devstack cinder-volume[86559]: INFO cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce ...
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d -c /etc/quobyte/client-cinder.cfg {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:27 devstack sudo[86565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d -c /etc/quobyte/client-cinder.cfg
Nov 05 11:51:27 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:27 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.398s {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:27 devstack cinder-volume[86559]: INFO cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce succeeded
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=86559) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.407s {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:27 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:51:27 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:27 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.230s {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:27 devstack cinder-volume[86559]: INFO cinder.volume.driver [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 11:51:27 devstack cinder-volume[86559]: DEBUG cinder.volume.driver [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4731140136719, 'free_capacity_gb': 1773.4731140136719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86559) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_db.sqlalchemy.engines [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:28 devstack cinder-volume[76431]: DEBUG oslo_concurrency.lockutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Acquiring lock "singleton_lock" {{(pid=76431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:28 devstack cinder-volume[76431]: DEBUG oslo_concurrency.lockutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Acquired lock "singleton_lock" {{(pid=76431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:28 devstack cinder-volume[76431]: DEBUG oslo_concurrency.lockutils [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Releasing lock "singleton_lock" {{(pid=76431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:28 devstack cinder-volume[76431]: WARNING amqp [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:28 devstack cinder-volume[76431]: WARNING amqp [None req-4bb562de-227a-4a70-ba5b-fabfdd3b4380 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG dbcounter [-] [86559] Writer thread running {{(pid=86559) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.db.api [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Building query based on filter {{(pid=86559) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.image.image_utils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86559) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 11:51:28 devstack cinder-volume[86559]: INFO cinder.keymgr.migration [None req-c7573b93-160a-4424-8db8-3cb0c589fe45 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=86559) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=86559) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:28 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:51:28 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:28 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.284s {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.manager [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Notifying Schedulers of capabilities ... {{(pid=86559) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:51:28 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Driver initialization completed successfully.
Nov 05 11:51:28 devstack cinder-volume[86559]: INFO cinder.manager [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Initiating service 3 cleanup
Nov 05 11:51:28 devstack cinder-volume[86559]: INFO cinder.manager [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Service 3 cleanup completed.
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.service [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Creating RPC server for service cinder-volume {{(pid=86559) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.service [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86559) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 11:51:28 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=86559) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG cinder.volume.drivers.quobyte [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=86559) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86559) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:28 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:51:28 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:28 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:28 devstack cinder-volume[86559]: DEBUG oslo_concurrency.processutils [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.249s {{(pid=86559) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:28 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-e273785e-5452-4da3-b6f8-fedecb26c50b None None] Driver post RPC initialization completed successfully.
Nov 05 11:51:33 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Caught SIGTERM, stopping children
Nov 05 11:51:33 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Acquiring lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:33 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Acquired lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:33 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Releasing lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Stop services. {{(pid=86340) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 11:51:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Killing children. {{(pid=86340) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 11:51:33 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Waiting on 1 children to exit
Nov 05 11:51:35 devstack cinder-volume[86559]: DEBUG oslo_service.periodic_task [None req-14f84923-cf0c-4e92-8337-0c30bb8f6ec3 None None] Running periodic task VolumeManager._thread_info {{(pid=86559) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:51:35 devstack cinder-volume[86559]: DEBUG cinder.volume.manager [None req-14f84923-cf0c-4e92-8337-0c30bb8f6ec3 None None] thread count: 6 {{(pid=86559) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:51:35 devstack cinder-volume[86559]: DEBUG cinder.volume.manager [None req-14f84923-cf0c-4e92-8337-0c30bb8f6ec3 None None] thread info: [<_MainThread(MainThread, started 125954701725824)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125954599559744)>, <Thread(Thread-3 (stat_writer), started daemon 125954590142528)>, <Thread(Rabbit-heartbeat, started daemon 125954587304384)>, <Thread(Thread-5 (_runner), started daemon 125954585309376)>, <Thread(Thread-7 (_runner), started daemon 125954585321472)>] {{(pid=86559) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:51:36 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Acquiring lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:36 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Acquired lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:36 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Releasing lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:36 devstack cinder-volume[86559]: WARNING amqp [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:36 devstack cinder-volume[86559]: WARNING amqp [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:36 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-ac82fe73-b80a-4f31-8289-ecbe67f0455c None None] Child 86559 exited with status 0
Nov 05 11:51:37 devstack cinder-volume[86882]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 11:51:37 devstack cinder-volume[86882]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:51:37 devstack cinder-volume[86882]: we strongly recommend against using it for new projects.
Nov 05 11:51:37 devstack cinder-volume[86882]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:51:37 devstack cinder-volume[86882]: framework.  For more detail see
Nov 05 11:51:37 devstack cinder-volume[86882]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:51:37 devstack cinder-volume[86882]:   import eventlet  # noqa
Nov 05 11:51:40 devstack cinder-volume[86882]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:40 devstack cinder-volume[86882]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:40 devstack cinder-volume[86882]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:41 devstack cinder-volume[86882]: INFO dbcounter [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Registered counter for database cinder
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86882) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG dbcounter [-] [86882] Writer thread running {{(pid=86882) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:41 devstack cinder-volume[86882]: INFO cinder.rpc [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 11:51:41 devstack cinder-volume[86882]: INFO cinder.rpc [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86882) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:41 devstack cinder-volume[86882]: INFO cinder.volume.manager [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Determined volume DB was empty at startup.
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG cinder.volume.manager [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86882) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 11:51:41 devstack cinder-volume[86882]: WARNING stevedore.named [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:51:41 devstack cinder-volume[86882]: WARNING castellan.key_manager [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:41 devstack cinder-volume[86882]: WARNING cinder.keymgr.conf_key_mgr [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:41 devstack cinder-volume[86882]: INFO cinder.volume.manager [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86882) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:41 devstack cinder-volume[86882]: INFO oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Starting 1 workers
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Started child 87184 {{(pid=86882) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Full set of CONF: {{(pid=86882) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] ******************************************************************************** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] Configuration options gathered from: {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] ================================================================================ {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 11:51:41 devstack cinder-volume[87184]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] allow_availability_zone_fallback = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] allow_compression_on_image_upload = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] allowed_direct_url_schemes     = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] api_rate_limit                 = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] auth_strategy                  = keystone {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_availability_zone      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_host                   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_name                   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_stats_polling_interval = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backup_api_class               = cinder.backup.api.API {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backup_name_template           = backup-%s {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backup_use_same_host           = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backup_use_temp_snapshot       = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] chap_password                  = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] chap_username                  =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_internal_tenant_project_id = 8ecba4e8495a48b1b8bea1df4d1fe903 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_internal_tenant_user_id = 2ecbc35afceb482abea9efe4d9258dd7 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cluster                        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] compression_format             = gzip {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] config_dir                     = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] config_source                  = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] control_exchange               = openstack {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] debug                          = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] default_availability_zone      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] default_group_type             = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] default_volume_type            = QuobyteHD {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] disk_geometry                  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] driver_client_cert             = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] driver_client_cert_key         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] driver_data_namespace          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] driver_ssl_cert_path           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] driver_ssl_cert_verify         = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] driver_use_ssl                 = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] enable_new_services            = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] enable_unsupported_driver      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] enforce_multipath_for_image_xfer = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] filter_function                = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_api_insecure            = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_api_servers             = ['http://192.168.122.28/image'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_api_ssl_compression     = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_ca_certificates_file    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_certfile                = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_keyfile                 = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_num_retries             = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance_request_timeout         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] goodness_function              = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] graceful_shutdown_timeout      = 5 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] group_api_class                = cinder.group.api.API {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] host                           = devstack {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_compress_on_upload       = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_conversion_address_space_limit = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_conversion_cpu_limit     = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_conversion_disable       = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_introspection_address_space_limit = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_introspection_cpu_limit  = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_upload_use_cinder_backend = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_upload_use_internal_tenant = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_volume_cache_enabled     = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_volume_cache_max_count   = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] init_host_max_objects_retrieval = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] iscsi_target_flags             =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] iscsi_write_cache              = on {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] iser_helper                    = tgtadm {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] iser_ip_address                = 192.168.122.28 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] iser_port                      = 3260 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_color                      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_config_append              = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_dir                        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_file                       = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_options                    = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_rotate_interval            = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_rotate_interval_type       = days {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] log_rotation_type              = none {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] max_age                        = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] max_logfile_count              = 30 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] max_logfile_size_mb            = 200 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] max_over_subscription_ratio    = 20.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] message_reap_interval          = 86400 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] message_ttl                    = 2592000 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] monkey_patch                   = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] monkey_patch_modules           = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] my_ip                          = 192.168.122.28 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] no_snapshot_gb_quota           = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] num_iser_scan_tries            = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] num_shell_tries                = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] num_volume_device_scan_tries   = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] nvmeof_conn_info_version       = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] nvmet_ns_id                    = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] nvmet_port_id                  = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] osapi_max_limit                = 1000 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] osapi_volume_ext_list          = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] osapi_volume_listen_port       = 8776 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] osapi_volume_use_ssl           = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] osapi_volume_workers           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] per_volume_size_limit          = -1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] periodic_fuzzy_delay           = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] periodic_interval              = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] public_endpoint                = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] publish_errors                 = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] quota_backup_gigabytes         = 1000 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] quota_backups                  = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] quota_gigabytes                = 1000 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] quota_groups                   = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] quota_snapshots                = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87184) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] quota_volumes                  = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] rate_limit_burst               = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] rate_limit_except_level        = CRITICAL {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] rate_limit_interval            = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] reinit_driver_count            = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] replication_device             = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] report_discard_supported       = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] report_interval                = 120 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] reservation_clean_interval     = 86400 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] reservation_expire             = 86400 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] reserved_image_namespaces      = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] reserved_percentage            = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] rpc_response_timeout           = 120 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] run_external_periodic_tasks    = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] scst_target_driver             = iscsi {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] scst_target_iqn_name           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_down_time              = 720 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] shell_completion               = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] snapshot_name_template         = snapshot-%s {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] split_loggers                  = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] state_path                     = /opt/stack/data/cinder {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] storage_availability_zone      = nova {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] storage_protocol               = iSCSI {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] syslog_log_facility            = LOG_USER {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] target_helper                  = lioadm {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] target_ip_address              = 192.168.122.28 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] target_port                    = 3260 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] target_protocol                = iscsi {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] target_secondary_ip_addresses  = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] trace_flags                    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] transport_url                  = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] until_refresh                  = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] use_chap_auth                  = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] use_default_quota_class        = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] use_journal                    = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] use_json                       = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] use_multipath_for_image_xfer   = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] use_stderr                     = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] use_syslog                     = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] verify_glance_signatures       = enabled {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_api_class               = cinder.volume.api.API {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_backend_name            = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_clear                   = zero {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_clear_ionice            = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_clear_size              = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_copy_bps_limit          = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_dd_blocksize            = 1M {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_name_template           = volume-%s {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_service_inithost_offload = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volume_usage_audit_period      = month {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] zoning_mode                    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.auth_section = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.auth_type   = password {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.auth_version = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.cache       = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.certfile    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.insecure    = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.interface   = public {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.keyfile     = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_password = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcache_username = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.region_name = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.service_type = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.backend                  = dogpile.cache.null {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.backend_argument         = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.backend_expiration_time  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.config_prefix            = cache.oslo {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.debug_cache_backend      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.enable_retry_client      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.enable_socket_keepalive  = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.enabled                  = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.expiration_time          = 600 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.memcache_dead_retry      = 300 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.memcache_sasl_enabled    = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.password                 = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.proxies                  = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.redis_db                 = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.redis_server             = localhost:6379 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.retry_attempts           = 2 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.retry_delay              = 0.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.socket_keepalive_count   = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.socket_keepalive_idle    = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.socket_keepalive_interval = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.socket_timeout           = 1.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.tls_allowed_ciphers      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.tls_cafile               = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.tls_certfile             = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.tls_enabled              = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.tls_keyfile              = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cache.username                 = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] coordination.backend_url       = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.asyncio_connection    = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.asyncio_slave_connection = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.backend               = sqlalchemy {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.connection            = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.connection_debug      = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.connection_parameters =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.connection_recycle_time = 3600 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.connection_trace      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.db_inc_retry_interval = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87184) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 11:51:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.db_max_retries        = 20 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.db_max_retry_interval = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.db_retry_interval     = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.max_overflow          = 50 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.max_pool_size         = 5 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.max_retries           = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Running cmd (subprocess): mount.quobyte {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.pool_timeout          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.retry_interval        = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.slave_connection      = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.sqlite_synchronous    = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.synchronous_reader    = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] database.use_db_reconnect      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_tracing.insecure = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.connection_string     = messaging:// {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.enabled               = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.es_doc_type           = notification {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.es_scroll_size        = 10000 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.es_scroll_time        = 2m {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.filter_error_trace    = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.hmac_keys             = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.sentinel_service_name = mymaster {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.socket_timeout        = 0.1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.trace_requests        = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler.trace_sqlalchemy      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler_jaeger.process_tags   = {} {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] profiler_otlp.service_name_prefix = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.policy_default_rule = default {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] privsep_osbrick.group          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] privsep_osbrick.helper_command = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] privsep_osbrick.user           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_sys_admin.group         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_sys_admin.helper_command = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] cinder_sys_admin.user          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.auth_section      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.auth_type         = password {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.cafile            = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.certfile          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.collect_timing    = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.insecure          = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.keyfile           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.send_service_user_token = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.split_loggers     = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.timeout           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.tls_ciphers       = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] service_user.tls_min_version   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.auth_section            = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.auth_type               = password {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.certfile                = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.collect_timing          = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.insecure                = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.keyfile                 = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.region_name             = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.split_loggers           = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.timeout                 = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.tls_ciphers             = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] glance.tls_min_version         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.backend_availability_zone = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.chap_password = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.chap_username =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.disk_geometry = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.driver_client_cert = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.driver_data_namespace = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.driver_use_ssl = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.extra_capabilities = {} {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.filter_function = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.goodness_function = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.iscsi_target_flags =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.iser_port     = 3260 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_host      =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_login     = admin {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_mount_options = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_password  = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack quobyte-client[87185]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 11:51:41 devstack quobyte-client[87185]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_private_key =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_share_path =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.replication_device = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.report_discard_supported = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.target_helper = tgtadm {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.target_port   = 3260 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.target_protocol = iscsi {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.trace_flags   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.use_chap_auth = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:41 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_backend_name = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_clear  = zero {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_reports.file_event_handler = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_reports.log_dir           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.backend_host         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.chap_password        = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.chap_username        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.disk_geometry        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.driver_client_cert   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.extra_capabilities   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.filter_function      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.goodness_function    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.iser_helper          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.iser_ip_address      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.iser_port            = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_host             = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_login            = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_mount_options    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_password         = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_private_key      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_share_path       = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.num_shell_tries      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.replication_device   = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.report_discard_supported = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.reserved_percentage  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.scst_target_driver   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.storage_protocol     = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.target_helper        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.target_ip_address    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.target_port          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.target_prefix        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.target_protocol      = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.trace_flags          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.use_chap_auth        = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_clear         = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_clear_size    = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] QuobyteHD.volumes_dir          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_notifications.driver = [] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] key_manager.fixed_key          = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.barbican_api_version  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.barbican_endpoint     = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.barbican_endpoint_type = public {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.barbican_region_name  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.cafile                = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.certfile              = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.collect_timing        = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.insecure              = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.keyfile               = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.number_of_retries     = 60 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.retry_delay           = 1 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.send_service_user_token = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.split_loggers         = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.timeout               = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.tls_ciphers           = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.tls_min_version       = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.verify_ssl            = True {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican.verify_ssl_path       = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.auth_section = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.auth_type = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.cafile   = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.certfile = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.collect_timing = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.insecure = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.keyfile  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.split_loggers = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.timeout  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.tls_ciphers = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] barbican_service_user.tls_min_version = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.approle_role_id          = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.approle_secret_id        = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.auth_method              = approle {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.auth_path                = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.kv_mountpoint            = secret {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.kv_path                  = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.kv_version               = 2 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.namespace                = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.root_token_id            = **** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.ssl_ca_crt_file          = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.timeout                  = 60.0 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.token_file               = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.token_role               = None {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.use_ssl                  = False {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:42 devstack cinder-volume[86882]: DEBUG oslo_service.backend._eventlet.service [None req-d6f28141-2348-47b2-b864-86f93d8b0fc8 None None] ******************************************************************************** {{(pid=86882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 11:51:42 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:42 devstack cinder-volume[87184]: INFO cinder.volume.driver [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.volume.driver [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4731140136719, 'free_capacity_gb': 1773.4731140136719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_db.sqlalchemy.engines [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writer thread running {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.db.api [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Building query based on filter {{(pid=87184) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87184) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:42 devstack cinder-volume[87184]: INFO cinder.keymgr.migration [None req-e8eb9a4d-0c29-4e96-88a4-b1ef7e690152 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 11:51:42 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:51:42 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:42 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:51:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Driver initialization completed successfully.
Nov 05 11:51:42 devstack cinder-volume[87184]: INFO cinder.manager [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Initiating service 3 cleanup
Nov 05 11:51:42 devstack cinder-volume[87184]: INFO cinder.manager [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Service 3 cleanup completed.
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.service [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Creating RPC server for service cinder-volume {{(pid=87184) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.service [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87184) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 11:51:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:42 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:51:42 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:43 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0f86a7a3-c39a-4727-86ef-93c9dbe7eafd None None] Driver post RPC initialization completed successfully.
Nov 05 11:51:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:51:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 6 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:51:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:51:51 devstack cinder-volume[86882]: DEBUG dbcounter [-] [86882] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86882) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:51:52 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:51:53 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:45 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:52:45 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:45 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 6 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:52:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:53:06 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Flow 'volume_create_manager' (f0fb66d8-3626-4cc7-8780-76a6d0301d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74140c2e-743f-4a33-a0dd-d04b3cac773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74140c2e-743f-4a33-a0dd-d04b3cac773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-175461578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d923f9a-13d9-4386-b890-2ef886570a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606635fa6e5542f8b000122cfc5be864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:06Z,use_quota=True,user_id='27037edd45b147cdbf13a09e09f8c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325ce0a6-4fd0-4dda-afaa-d3c4106e1e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325ce0a6-4fd0-4dda-afaa-d3c4106e1e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837ea3d3-d01a-4609-a74e-9ad6f2e183b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837ea3d3-d01a-4609-a74e-9ad6f2e183b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d923f9a-13d9-4386-b890-2ef886570a75', 'volume_name': 'volume-2d923f9a-13d9-4386-b890-2ef886570a75', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4adc1d-01f9-4f21-b4ed-d86aa4593b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4adc1d-01f9-4f21-b4ed-d86aa4593b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cca41c-d5ef-4a3e-961d-5aeb76b638a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Volume 2d923f9a-13d9-4386-b890-2ef886570a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d923f9a-13d9-4386-b890-2ef886570a75', 'volume_size': 1}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-175461578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d923f9a-13d9-4386-b890-2ef886570a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606635fa6e5542f8b000122cfc5be864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:06Z,use_quota=True,user_id='27037edd45b147cdbf13a09e09f8c399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Creating volume 2d923f9a-13d9-4386-b890-2ef886570a75 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:53:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:07 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75 1073741824
Nov 05 11:53:07 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:08 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75 1073741824" returned: 0 in 1.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:08 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75
Nov 05 11:53:08 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:09 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75" returned: 0 in 0.976s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] <== create_volume: return (2497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cca41c-d5ef-4a3e-961d-5aeb76b638a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d923f9a-13d9-4386-b890-2ef886570a75', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d361538f-ea9d-4479-a4e1-7962399a849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Volume volume-2d923f9a-13d9-4386-b890-2ef886570a75 (2d923f9a-13d9-4386-b890-2ef886570a75): created successfully
Nov 05 11:53:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d361538f-ea9d-4479-a4e1-7962399a849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Flow 'volume_create_manager' (f0fb66d8-3626-4cc7-8780-76a6d0301d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-53e6fc80-df3a-446a-95f5-6e230c78ea63 tempest-DeleteServersTestJSON-730415608 None] Created volume successfully.
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Flow 'volume_create_manager' (49b3bfec-22aa-4ef9-94aa-fb32ede0bfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc1ec0c-1a1e-4e46-9ea4-f86d2962e297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc1ec0c-1a1e-4e46-9ea4-f86d2962e297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1041504236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d878011-cc64-468e-aa1c-9747098b7dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f9eb970c424f1dad5a91912ec108a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:13Z,use_quota=True,user_id='e37ba0a2183449bd96c9bc72451db492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dc38d7-666d-4d40-a711-f9ff57e07309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dc38d7-666d-4d40-a711-f9ff57e07309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30867745-2f3b-4346-a375-e519ba588ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30867745-2f3b-4346-a375-e519ba588ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d878011-cc64-468e-aa1c-9747098b7dd8', 'volume_name': 'volume-4d878011-cc64-468e-aa1c-9747098b7dd8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85f6288-5ce0-4f21-888f-62ff19052d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85f6288-5ce0-4f21-888f-62ff19052d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11debba8-dcb3-49a6-bfb4-a4dcb5171a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Volume 4d878011-cc64-468e-aa1c-9747098b7dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d878011-cc64-468e-aa1c-9747098b7dd8', 'volume_size': 1}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1041504236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d878011-cc64-468e-aa1c-9747098b7dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f9eb970c424f1dad5a91912ec108a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:13Z,use_quota=True,user_id='e37ba0a2183449bd96c9bc72451db492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Creating volume 4d878011-cc64-468e-aa1c-9747098b7dd8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:13 devstack sudo[88417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8 1073741824
Nov 05 11:53:13 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:13 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8 1073741824" returned: 0 in 0.653s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:13 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8
Nov 05 11:53:13 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:14 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8" returned: 0 in 0.338s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11debba8-dcb3-49a6-bfb4-a4dcb5171a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d878011-cc64-468e-aa1c-9747098b7dd8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b196d-fdf3-4aaa-a922-b8728838b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Volume volume-4d878011-cc64-468e-aa1c-9747098b7dd8 (4d878011-cc64-468e-aa1c-9747098b7dd8): created successfully
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b196d-fdf3-4aaa-a922-b8728838b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Flow 'volume_create_manager' (49b3bfec-22aa-4ef9-94aa-fb32ede0bfdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-81295c77-03ac-42d5-ad0c-afd008875c70 tempest-VolumesAdminNegativeTest-2594486 None] Created volume successfully.
Nov 05 11:53:14 devstack cinder-volume[87184]: WARNING py.warnings [req-fc140787-329f-420f-be46-35022bcdc3e7 req-b2e1117a-7119-4a8f-9870-8a37468595c6 tempest-DeleteServersTestJSON-730415608 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 05 11:53:14 devstack cinder-volume[87184]:   .first()
Nov 05 11:53:14 devstack cinder-volume[87184]: 
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-fc140787-329f-420f-be46-35022bcdc3e7 req-b2e1117a-7119-4a8f-9870-8a37468595c6 tempest-DeleteServersTestJSON-730415608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-fc140787-329f-420f-be46-35022bcdc3e7 req-b2e1117a-7119-4a8f-9870-8a37468595c6 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-fc140787-329f-420f-be46-35022bcdc3e7 req-b2e1117a-7119-4a8f-9870-8a37468595c6 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-fc140787-329f-420f-be46-35022bcdc3e7 req-b2e1117a-7119-4a8f-9870-8a37468595c6 tempest-DeleteServersTestJSON-730415608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-2d923f9a-13d9-4386-b890-2ef886570a75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed676055-0db6-49fb-8dff-50a9bfc48c46', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:53:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-fc140787-329f-420f-be46-35022bcdc3e7 req-b2e1117a-7119-4a8f-9870-8a37468595c6 tempest-DeleteServersTestJSON-730415608 None] attachment_update completed successfully.
Nov 05 11:53:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Acquiring lock "cinder-4d878011-cc64-468e-aa1c-9747098b7dd8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Lock "cinder-4d878011-cc64-468e-aa1c-9747098b7dd8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Acquiring lock "cinder-quobyte-4d878011-cc64-468e-aa1c-9747098b7dd8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Lock "cinder-quobyte-4d878011-cc64-468e-aa1c-9747098b7dd8" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:16 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbmem9_pt/privsep.sock']
Nov 05 11:53:16 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbmem9_pt/privsep.sock
Nov 05 11:53:16 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 11:53:17 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 11:53:17 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:17 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Spawned new privsep daemon via rootwrap
Nov 05 11:53:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Accepted privsep connection to /tmp/tmpbmem9_pt/privsep.sock {{(pid=87184) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 11:53:17 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 11:53:17 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 11:53:17 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 11:53:17 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88859
Nov 05 11:53:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bd354f-fd56-4cfe-afb1-c8ff6ed57e5f]: (2,) {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec5bb4-f742-4670-9003-970dfaba5594]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:18 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8
Nov 05 11:53:18 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:19 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8" returned: 0 in 1.101s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:19 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8
Nov 05 11:53:19 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:19 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d878011-cc64-468e-aa1c-9747098b7dd8" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Lock "cinder-quobyte-4d878011-cc64-468e-aa1c-9747098b7dd8" released by "delete_volume" :: held 3.226s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:19 devstack cinder-volume[87184]: WARNING cinder.quota [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:53:19 devstack cinder-volume[87184]: WARNING cinder.quota [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Created reservations ['76dd6a79-6fd3-4866-a228-8ce3b1d8087e', 'ef2cd57c-d4b6-4996-bda6-8d363468d0d8', '343f833c-2678-4f51-b048-2444c571a249', '3c491ce1-c8dc-4f31-9308-e6897a42bf62'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:19 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:53:19 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:20 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.326s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:20 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Deleted volume successfully.
Nov 05 11:53:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3b87f34-0b14-48e1-9905-6ca1d6ae1fbf tempest-VolumesAdminNegativeTest-2594486 None] Lock "cinder-4d878011-cc64-468e-aa1c-9747098b7dd8-delete_volume" released by "delete_volume" :: held 4.112s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-61199d6a-b590-40f7-bdbd-83cd07254621 req-8a8d6061-c394-4a0b-969c-6558a3054d70 tempest-DeleteServersTestJSON-730415608 None] Terminate volume connection completed successfully.
Nov 05 11:53:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-61199d6a-b590-40f7-bdbd-83cd07254621 req-8a8d6061-c394-4a0b-969c-6558a3054d70 tempest-DeleteServersTestJSON-730415608 None] Deleting attachment ed676055-0db6-49fb-8dff-50a9bfc48c46. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:53:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Acquiring lock "cinder-2d923f9a-13d9-4386-b890-2ef886570a75-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Lock "cinder-2d923f9a-13d9-4386-b890-2ef886570a75-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Acquiring lock "cinder-quobyte-2d923f9a-13d9-4386-b890-2ef886570a75" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Lock "cinder-quobyte-2d923f9a-13d9-4386-b890-2ef886570a75" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a179c-f41b-4f6b-94da-4524991bf98d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:24 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75
Nov 05 11:53:24 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:24 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:24 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75
Nov 05 11:53:24 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:24 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d923f9a-13d9-4386-b890-2ef886570a75" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Lock "cinder-quobyte-2d923f9a-13d9-4386-b890-2ef886570a75" released by "delete_volume" :: held 0.783s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:24 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Created reservations ['97c6fff2-fde3-4cc9-a9a9-22d41e810ff0', '61252100-bee3-4e32-82ba-c1898ee66117', '6f0edf43-a79b-42a9-a5ef-de7b91eed55d', 'a99b501d-1452-4cd2-908d-eefd2595de4a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:25 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:53:25 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Flow 'volume_create_manager' (74fd2190-a5a1-4de4-af41-9b97caccdba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361c046-5800-4aec-97c4-4c1330b3daa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361c046-5800-4aec-97c4-4c1330b3daa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1521656101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2db35d5-4059-4f70-b591-f45dd97e41e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c486c006d34f4a1fbe03299c16abe6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:25Z,use_quota=True,user_id='bb566031457b4031866321d03baf5a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b6b561-0c56-4b70-90a2-15757f4ff057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b6b561-0c56-4b70-90a2-15757f4ff057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7742be6-6026-4ab1-aabb-2f5c5d2f0b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7742be6-6026-4ab1-aabb-2f5c5d2f0b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2db35d5-4059-4f70-b591-f45dd97e41e9', 'volume_name': 'volume-b2db35d5-4059-4f70-b591-f45dd97e41e9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a577c1-0867-49c3-b34b-aa4a60225459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a577c1-0867-49c3-b34b-aa4a60225459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3842727-ce3a-4293-847e-1ff316b1d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Volume b2db35d5-4059-4f70-b591-f45dd97e41e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2db35d5-4059-4f70-b591-f45dd97e41e9', 'volume_size': 1}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1521656101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2db35d5-4059-4f70-b591-f45dd97e41e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c486c006d34f4a1fbe03299c16abe6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:25Z,use_quota=True,user_id='bb566031457b4031866321d03baf5a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Creating volume b2db35d5-4059-4f70-b591-f45dd97e41e9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:25 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:25 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:25 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9 1073741824
Nov 05 11:53:25 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Deleted volume successfully.
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2cd1301-5868-47c9-9780-e5e018edab89 tempest-DeleteServersTestJSON-730415608 None] Lock "cinder-2d923f9a-13d9-4386-b890-2ef886570a75-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:25 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9 1073741824" returned: 0 in 0.550s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:25 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9
Nov 05 11:53:25 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:26 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3842727-ce3a-4293-847e-1ff316b1d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2db35d5-4059-4f70-b591-f45dd97e41e9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f6f97b-cad7-4c36-8232-72b2f21b5a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Volume volume-b2db35d5-4059-4f70-b591-f45dd97e41e9 (b2db35d5-4059-4f70-b591-f45dd97e41e9): created successfully
Nov 05 11:53:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f6f97b-cad7-4c36-8232-72b2f21b5a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Flow 'volume_create_manager' (74fd2190-a5a1-4de4-af41-9b97caccdba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-30ec49de-b8c5-4f3c-a4a3-cc04ae57d7f1 tempest-ServerActionsTestOtherA-1727747723 None] Created volume successfully.
Nov 05 11:53:36 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:53:36 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=24,cinder:SELECT=20,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:45 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:53:45 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:45 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.314s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 8 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:53:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:53:53 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:53:53 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Flow 'volume_create_manager' (d3d3a61c-51a2-4a2c-8be9-741ceb4da184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b95885-7325-4750-bbe3-ba0491c8c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b95885-7325-4750-bbe3-ba0491c8c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1339321471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e8b3c8-c040-4359-af0a-64da2e9b642d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a780504270349da8cf2b5ddbaf95f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:01Z,use_quota=True,user_id='6bc9cdb612774376b773ab97629bc0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582e774f-db4f-4d06-b15a-1ef0b4591f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582e774f-db4f-4d06-b15a-1ef0b4591f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6820e14a-18e6-4d3c-b48b-4e2930650439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6820e14a-18e6-4d3c-b48b-4e2930650439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e8b3c8-c040-4359-af0a-64da2e9b642d', 'volume_name': 'volume-96e8b3c8-c040-4359-af0a-64da2e9b642d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efbfcf7-e574-434b-a4ff-51e161f1cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efbfcf7-e574-434b-a4ff-51e161f1cb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c0fc90-6bfb-478f-8d63-ccf2b9dc8508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Volume 96e8b3c8-c040-4359-af0a-64da2e9b642d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e8b3c8-c040-4359-af0a-64da2e9b642d', 'volume_size': 1}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1339321471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e8b3c8-c040-4359-af0a-64da2e9b642d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a780504270349da8cf2b5ddbaf95f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:01Z,use_quota=True,user_id='6bc9cdb612774376b773ab97629bc0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Creating volume 96e8b3c8-c040-4359-af0a-64da2e9b642d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:54:01 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:54:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:01 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d 1073741824
Nov 05 11:54:01 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:02 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d 1073741824" returned: 0 in 1.025s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:02 devstack sudo[89134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d
Nov 05 11:54:02 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:03 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d" returned: 0 in 0.783s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:54:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c0fc90-6bfb-478f-8d63-ccf2b9dc8508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e8b3c8-c040-4359-af0a-64da2e9b642d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89db17a8-5747-4a0f-ae39-29a62fb79237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Volume volume-96e8b3c8-c040-4359-af0a-64da2e9b642d (96e8b3c8-c040-4359-af0a-64da2e9b642d): created successfully
Nov 05 11:54:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89db17a8-5747-4a0f-ae39-29a62fb79237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Flow 'volume_create_manager' (d3d3a61c-51a2-4a2c-8be9-741ceb4da184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5ce22c27-1fed-4532-b59d-db62ea97ef99 tempest-TaggedAttachmentsTest-1996190580 None] Created volume successfully.
Nov 05 11:54:13 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:13 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f70f4c6a-7b95-4fa4-933a-16d91ab3b651 req-3cb45d0e-ca19-4de2-aeaf-4297a06e2428 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f70f4c6a-7b95-4fa4-933a-16d91ab3b651 req-3cb45d0e-ca19-4de2-aeaf-4297a06e2428 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f70f4c6a-7b95-4fa4-933a-16d91ab3b651 req-3cb45d0e-ca19-4de2-aeaf-4297a06e2428 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-f70f4c6a-7b95-4fa4-933a-16d91ab3b651 req-3cb45d0e-ca19-4de2-aeaf-4297a06e2428 tempest-ServerActionsTestOtherA-1727747723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-b2db35d5-4059-4f70-b591-f45dd97e41e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62b66e88-9f9e-4a36-a7ac-ae89121ab007', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:54:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-f70f4c6a-7b95-4fa4-933a-16d91ab3b651 req-3cb45d0e-ca19-4de2-aeaf-4297a06e2428 tempest-ServerActionsTestOtherA-1727747723 None] attachment_update completed successfully.
Nov 05 11:54:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-ed26aecb-c726-4d65-95d6-08cdae601a67 req-4a632506-779a-4067-896a-d9d1c8525067 tempest-ServerActionsTestOtherA-1727747723 None] Terminate volume connection completed successfully.
Nov 05 11:54:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-ed26aecb-c726-4d65-95d6-08cdae601a67 req-4a632506-779a-4067-896a-d9d1c8525067 tempest-ServerActionsTestOtherA-1727747723 None] Deleting attachment 62b66e88-9f9e-4a36-a7ac-ae89121ab007. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Flow 'volume_create_manager' (69a1909b-93a1-4eb3-ae07-e589e0e6e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743e9408-2003-4b73-ad65-db4cc9a41693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743e9408-2003-4b73-ad65-db4cc9a41693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1548776330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac0450b-bec5-4223-8ec7-ff0bec632951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8103120d195f4dd9bb7bdf8654d763fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:39Z,use_quota=True,user_id='4a56714e1a704e4fb42eb3909d24c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44202e3d-24c8-4ad4-8898-9bd5a58b9cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44202e3d-24c8-4ad4-8898-9bd5a58b9cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659af4ea-8f2c-49b2-95b2-ce40b5c5bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659af4ea-8f2c-49b2-95b2-ce40b5c5bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac0450b-bec5-4223-8ec7-ff0bec632951', 'volume_name': 'volume-6ac0450b-bec5-4223-8ec7-ff0bec632951', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f062a-4a38-4d43-aa05-ddc47d9490e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f062a-4a38-4d43-aa05-ddc47d9490e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317cdaa7-7338-44ee-9fb2-0892f3fc7ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Volume 6ac0450b-bec5-4223-8ec7-ff0bec632951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac0450b-bec5-4223-8ec7-ff0bec632951', 'volume_size': 1}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1548776330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac0450b-bec5-4223-8ec7-ff0bec632951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8103120d195f4dd9bb7bdf8654d763fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:39Z,use_quota=True,user_id='4a56714e1a704e4fb42eb3909d24c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Creating volume 6ac0450b-bec5-4223-8ec7-ff0bec632951 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:54:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:54:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:39 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951 1073741824
Nov 05 11:54:39 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-ed26aecb-c726-4d65-95d6-08cdae601a67 req-39c84298-85a4-46cf-bbab-9fc66b898cb8 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:41 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951 1073741824" returned: 0 in 1.582s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:41 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951
Nov 05 11:54:41 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:41 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:54:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.418s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-ed26aecb-c726-4d65-95d6-08cdae601a67 req-39c84298-85a4-46cf-bbab-9fc66b898cb8 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.968s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317cdaa7-7338-44ee-9fb2-0892f3fc7ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac0450b-bec5-4223-8ec7-ff0bec632951', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aade2cf9-1ddc-4f8c-bf96-5a50c141eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Volume volume-6ac0450b-bec5-4223-8ec7-ff0bec632951 (6ac0450b-bec5-4223-8ec7-ff0bec632951): created successfully
Nov 05 11:54:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aade2cf9-1ddc-4f8c-bf96-5a50c141eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Flow 'volume_create_manager' (69a1909b-93a1-4eb3-ae07-e589e0e6e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-ed26aecb-c726-4d65-95d6-08cdae601a67 req-39c84298-85a4-46cf-bbab-9fc66b898cb8 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.232s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-027c34a3-cfaa-4a3f-b038-cb61d0f51ece tempest-ServerRescueNegativeTestJSON-465080718 None] Created volume successfully.
Nov 05 11:54:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-ed26aecb-c726-4d65-95d6-08cdae601a67 req-39c84298-85a4-46cf-bbab-9fc66b898cb8 tempest-ServerActionsTestOtherA-1727747723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-b2db35d5-4059-4f70-b591-f45dd97e41e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92a2fbe6-b122-4813-96fd-2e7dd36f3ffb', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:54:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-ed26aecb-c726-4d65-95d6-08cdae601a67 req-39c84298-85a4-46cf-bbab-9fc66b898cb8 tempest-ServerActionsTestOtherA-1727747723 None] attachment_update completed successfully.
Nov 05 11:54:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:54:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.081s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:45 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:54:45 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:46 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.951s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:54:46 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:54:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 8 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:54:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:54:52 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:52 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Acquiring lock "cinder-6ac0450b-bec5-4223-8ec7-ff0bec632951-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "cinder-6ac0450b-bec5-4223-8ec7-ff0bec632951-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Acquiring lock "cinder-quobyte-6ac0450b-bec5-4223-8ec7-ff0bec632951" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "cinder-quobyte-6ac0450b-bec5-4223-8ec7-ff0bec632951" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f90ebd-c25a-496a-a6d4-9a726da50f04]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:56 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951
Nov 05 11:54:56 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:56 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:56 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951
Nov 05 11:54:56 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:57 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ac0450b-bec5-4223-8ec7-ff0bec632951" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "cinder-quobyte-6ac0450b-bec5-4223-8ec7-ff0bec632951" released by "delete_volume" :: held 0.797s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Created reservations ['f6c577e5-5630-4d92-8f16-9bc91f984bcd', '05783601-db22-4915-8f3b-2cfa659d80fd', '05db3428-5838-44e9-ad79-be3c0f4ec381', 'eb584640-def4-439e-bc3c-f46a4f42e44a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:57 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:54:57 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:57 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.459s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:57 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:54:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Deleted volume successfully.
Nov 05 11:54:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53309cd9-7712-40cf-aa40-18346b8f680b tempest-ServerRescueNegativeTestJSON-465080718 None] Lock "cinder-6ac0450b-bec5-4223-8ec7-ff0bec632951-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:55:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Flow 'volume_create_manager' (5c9eb661-e57e-488e-9502-b1ed0fb452c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8b36ac-4095-4d07-b7d6-0b89e0daae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8b36ac-4095-4d07-b7d6-0b89e0daae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-533239395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598ac4e9-07da-49ef-b2ee-cd69ca633c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6629943548e43e5bd8db4889533aad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:18Z,use_quota=True,user_id='67984c8f032c4974a906ebbdf0e17e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43e1766-b2e8-42f6-b83e-cc9b329887b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43e1766-b2e8-42f6-b83e-cc9b329887b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f97185-406e-4e7c-b644-e090aa0c79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f97185-406e-4e7c-b644-e090aa0c79c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598ac4e9-07da-49ef-b2ee-cd69ca633c59', 'volume_name': 'volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e871fd7-8fef-4a86-a9b2-7074215e59cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e871fd7-8fef-4a86-a9b2-7074215e59cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44797d0-a722-475d-9de7-e909da21281b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Volume 598ac4e9-07da-49ef-b2ee-cd69ca633c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59', 'volume_size': 1}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-533239395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598ac4e9-07da-49ef-b2ee-cd69ca633c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6629943548e43e5bd8db4889533aad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:18Z,use_quota=True,user_id='67984c8f032c4974a906ebbdf0e17e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Creating volume 598ac4e9-07da-49ef-b2ee-cd69ca633c59 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:55:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:18 devstack sudo[91452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59 1073741824
Nov 05 11:55:18 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:18 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59 1073741824" returned: 0 in 0.538s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:19 devstack sudo[91467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59
Nov 05 11:55:19 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7eef04a9-d560-49b2-8366-03d0be8c7310 req-3cf4a4a8-7647-4892-9f0d-845906f295b2 tempest-TaggedAttachmentsTest-1996190580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:19 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7eef04a9-d560-49b2-8366-03d0be8c7310 req-3cf4a4a8-7647-4892-9f0d-845906f295b2 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.232s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44797d0-a722-475d-9de7-e909da21281b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90db4626-3d3e-42c5-bfa8-d5555172bbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7eef04a9-d560-49b2-8366-03d0be8c7310 req-3cf4a4a8-7647-4892-9f0d-845906f295b2 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Volume volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59 (598ac4e9-07da-49ef-b2ee-cd69ca633c59): created successfully
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90db4626-3d3e-42c5-bfa8-d5555172bbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Flow 'volume_create_manager' (5c9eb661-e57e-488e-9502-b1ed0fb452c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-33912d7a-e140-4f73-98b1-3ceefcc13bed tempest-AttachVolumeShelveTestJSON-87319608 None] Created volume successfully.
Nov 05 11:55:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-7eef04a9-d560-49b2-8366-03d0be8c7310 req-3cf4a4a8-7647-4892-9f0d-845906f295b2 tempest-TaggedAttachmentsTest-1996190580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-96e8b3c8-c040-4359-af0a-64da2e9b642d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78c42eb7-8cac-4279-80e6-fcb2d3099001', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:55:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-7eef04a9-d560-49b2-8366-03d0be8c7310 req-3cf4a4a8-7647-4892-9f0d-845906f295b2 tempest-TaggedAttachmentsTest-1996190580 None] attachment_update completed successfully.
Nov 05 11:55:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-822802e5-9665-42d9-8e0c-60341917bd58 req-45b8378f-a8ba-46ae-a52f-e20bbc6ada63 tempest-TaggedAttachmentsTest-1996190580 None] Terminate volume connection completed successfully.
Nov 05 11:55:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-822802e5-9665-42d9-8e0c-60341917bd58 req-45b8378f-a8ba-46ae-a52f-e20bbc6ada63 tempest-TaggedAttachmentsTest-1996190580 None] Deleting attachment 78c42eb7-8cac-4279-80e6-fcb2d3099001. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:55:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-6ac729fb-d47e-4c16-b604-3514dead566f req-6ef10b92-85c4-4251-bcee-4e332370ceb6 tempest-ServerActionsTestOtherA-1727747723 None] Terminate volume connection completed successfully.
Nov 05 11:55:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-6ac729fb-d47e-4c16-b604-3514dead566f req-6ef10b92-85c4-4251-bcee-4e332370ceb6 tempest-ServerActionsTestOtherA-1727747723 None] Deleting attachment 92a2fbe6-b122-4813-96fd-2e7dd36f3ffb. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:55:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-585c26b4-26ed-4cfd-af40-69670c539f8a req-12dfb480-d875-4c46-80a0-ef4f62ca56aa tempest-AttachVolumeShelveTestJSON-87319608 None] No connector for attachment ce7ea8ac-0090-4904-9000-1ba1d4ca65c6; skipping storage backend terminate_connection call. {{(pid=87184) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}}
Nov 05 11:55:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-585c26b4-26ed-4cfd-af40-69670c539f8a req-12dfb480-d875-4c46-80a0-ef4f62ca56aa tempest-AttachVolumeShelveTestJSON-87319608 None] Deleting attachment ce7ea8ac-0090-4904-9000-1ba1d4ca65c6. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:55:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Acquiring lock "cinder-96e8b3c8-c040-4359-af0a-64da2e9b642d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Lock "cinder-96e8b3c8-c040-4359-af0a-64da2e9b642d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Acquiring lock "cinder-quobyte-96e8b3c8-c040-4359-af0a-64da2e9b642d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Lock "cinder-quobyte-96e8b3c8-c040-4359-af0a-64da2e9b642d" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aae65b-2ac2-4812-85d6-f24190672d1e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:34 devstack sudo[91604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d
Nov 05 11:55:34 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:35 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d" returned: 0 in 0.694s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:35 devstack sudo[91612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d
Nov 05 11:55:35 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:35 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-96e8b3c8-c040-4359-af0a-64da2e9b642d" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Lock "cinder-quobyte-96e8b3c8-c040-4359-af0a-64da2e9b642d" released by "delete_volume" :: held 1.269s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Created reservations ['d4131d3e-feb0-49ca-b610-f76da45cbac0', '69576084-4686-4e2c-805d-2e8902427635', '2d969d96-1510-4120-b94a-ff11a2ef79f9', '60cff1b0-9c52-43a1-bb2a-afb5c482be0f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:36 devstack sudo[91619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:55:36 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:36 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Deleted volume successfully.
Nov 05 11:55:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37723fe3-2d10-4938-8bd9-a541f56cb4c8 tempest-TaggedAttachmentsTest-1996190580 None] Lock "cinder-96e8b3c8-c040-4359-af0a-64da2e9b642d-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-92c6a4fc-74f5-4e19-9d95-1140548236af tempest-GroupsV314Test-797193814 None] Group tempest-GroupsV314Test-Group-1097775002: creating
Nov 05 11:55:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-92c6a4fc-74f5-4e19-9d95-1140548236af tempest-GroupsV314Test-797193814 None] Group tempest-GroupsV314Test-Group-1097775002: created successfully
Nov 05 11:55:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-92c6a4fc-74f5-4e19-9d95-1140548236af tempest-GroupsV314Test-797193814 None] Create group completed successfully.
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Flow 'volume_create_manager' (ef8faa95-39c5-459a-9b3b-40c044fa39b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36871f6c-1599-4e6c-99ed-bc88c7d1a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36871f6c-1599-4e6c-99ed-bc88c7d1a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387536168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1b0a6c07-8188-4a22-8dd8-8addabafadfb,host='devstack@QuobyteHD#QuobyteHD',id=b4ec811c-b34c-4dce-9a6a-208c50d4bf9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a7a21330824623aaeae02a46380a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:39Z,use_quota=True,user_id='e9028366e5e349139aa21e340fa9c5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a64565d2-2976-42a1-9595-30ae8f84c791),volume_type_id=a64565d2-2976-42a1-9595-30ae8f84c791)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1a0f2a-171f-46c1-8cca-15b5604c63ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1a0f2a-171f-46c1-8cca-15b5604c63ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10537ab1-dd4f-45a3-b242-6ec1721126e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10537ab1-dd4f-45a3-b242-6ec1721126e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ec811c-b34c-4dce-9a6a-208c50d4bf9b', 'volume_name': 'volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051fd611-1f0d-427c-9e2f-ad57e088bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051fd611-1f0d-427c-9e2f-ad57e088bff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb210957-fcdb-4cb0-b61d-617244f19d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Volume b4ec811c-b34c-4dce-9a6a-208c50d4bf9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b', 'volume_size': 1}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1b0a6c07-8188-4a22-8dd8-8addabafadfb,created_at=2026-11-05T10:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387536168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1b0a6c07-8188-4a22-8dd8-8addabafadfb,host='devstack@QuobyteHD#QuobyteHD',id=b4ec811c-b34c-4dce-9a6a-208c50d4bf9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a7a21330824623aaeae02a46380a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:39Z,use_quota=True,user_id='e9028366e5e349139aa21e340fa9c5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a64565d2-2976-42a1-9595-30ae8f84c791),volume_type_id=a64565d2-2976-42a1-9595-30ae8f84c791)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Creating volume b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:55:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:39 devstack sudo[91636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b 1073741824
Nov 05 11:55:39 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:39 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b 1073741824" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:39 devstack sudo[91643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b
Nov 05 11:55:39 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:40 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:55:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb210957-fcdb-4cb0-b61d-617244f19d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40861ea8-a8fe-4c8a-a1c9-e2a12d1dbf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Volume volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b (b4ec811c-b34c-4dce-9a6a-208c50d4bf9b): created successfully
Nov 05 11:55:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40861ea8-a8fe-4c8a-a1c9-e2a12d1dbf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Flow 'volume_create_manager' (ef8faa95-39c5-459a-9b3b-40c044fa39b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ff0a8bff-b372-42b6-935c-d475a7037387 tempest-GroupsV314Test-797193814 None] Created volume successfully.
Nov 05 11:55:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Cloning volume b4ec811c-b34c-4dce-9a6a-208c50d4bf9b to volume 9fe63edd-f802-4abf-8fd8-f22f36f60672
Nov 05 11:55:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Creating offline snapshot ea0053a1-0a7b-4848-b7cc-a26070fb46cd of volume b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:55:41 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9171176-95b2-47f8-a2a7-be8dbe81ccab]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:41 devstack sudo[91652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b
Nov 05 11:55:41 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:42 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" returned: 0 in 0.745s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:42 devstack sudo[91657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd 1G
Nov 05 11:55:42 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Flow 'volume_create_manager' (7443aec7-9d9c-4504-9f95-64c442e6f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbb23f4-e151-4d4d-ad79-d8fc77226322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbb23f4-e151-4d4d-ad79-d8fc77226322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1135426009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984c12bf-af7c-41f7-ba6b-92e0348a58f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c486c006d34f4a1fbe03299c16abe6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:43Z,use_quota=True,user_id='bb566031457b4031866321d03baf5a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425ba447-7c4e-48ad-9d2d-f3114e89307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425ba447-7c4e-48ad-9d2d-f3114e89307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea60b84-a083-4869-8a46-55192d3c9f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:42 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 11:55:43 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd 1G" returned: 0 in 0.660s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:43 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd
Nov 05 11:55:43 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea60b84-a083-4869-8a46-55192d3c9f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '984c12bf-af7c-41f7-ba6b-92e0348a58f2', 'volume_name': 'volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104543ba780>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40343d8b-f4d5-4676-98e3-195084b304e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40343d8b-f4d5-4676-98e3-195084b304e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181adf33-b543-4239-bd49-1e23a49be96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Volume 984c12bf-af7c-41f7-ba6b-92e0348a58f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104543ba780>}
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Trying to clone 984c12bf-af7c-41f7-ba6b-92e0348a58f2 from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 11:55:43 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd" returned: 0 in 0.561s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:43 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:43 devstack sudo[91700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd
Nov 05 11:55:43 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 11:55:43 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b38c76d-0665-4886-997e-5b8cb2758950]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:43 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:44 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.info
Nov 05 11:55:44 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:44 devstack sudo[91705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD
Nov 05 11:55:44 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:44 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 is fetched for user bb566031457b4031866321d03baf5a06. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 11:55:44 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.info" returned: 0 in 0.356s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:44 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:44 devstack sudo[91725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.info
Nov 05 11:55:44 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbfc34e-251e-4644-b49c-3a405ce3d1c3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:44 devstack sudo[91728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD
Nov 05 11:55:44 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:44 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.info" returned: 0 in 0.310s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Acquiring lock "cinder-quobyte-9fe63edd-f802-4abf-8fd8-f22f36f60672" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-9fe63edd-f802-4abf-8fd8-f22f36f60672" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] snapshot: ea0053a1-0a7b-4848-b7cc-a26070fb46cd, volume: 9fe63edd-f802-4abf-8fd8-f22f36f60672,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df4aca1-d5e6-47a1-96d2-b3e9f80addfe]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:44 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:44 devstack sudo[91746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd
Nov 05 11:55:44 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:45 devstack sudo[91750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:55:45 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:45 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fadf59e-f20d-467e-9c4a-ec87b6fbd87c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:45 devstack sudo[91753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b
Nov 05 11:55:45 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:45 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:45 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 11:55:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:45 devstack sudo[91759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672
Nov 05 11:55:45 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:54 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=27,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:55:54 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=17,cinder:SELECT=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:55:56 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672" returned: 0 in 10.535s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b, size 1024.00 MB, duration 10.54 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:55:56 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Converted 1024.00 MB image at 97.19 MB/s
Nov 05 11:55:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:56 devstack sudo[91899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672
Nov 05 11:55:56 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:56 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672" returned: 0 in 0.335s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-9fe63edd-f802-4abf-8fd8-f22f36f60672" released by "_copy_volume_from_snapshot" :: held 11.954s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Acquiring lock "cinder-quobyte-ea0053a1-0a7b-4848-b7cc-a26070fb46cd" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-ea0053a1-0a7b-4848-b7cc-a26070fb46cd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Deleting offline snapshot ea0053a1-0a7b-4848-b7cc-a26070fb46cd of volume b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] snapshot_file for this snap is: volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a1da2b-e19f-43d5-a329-de476a67a9c1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:56 devstack sudo[91903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd
Nov 05 11:55:56 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:57 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd" returned: 0 in 0.468s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:55:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4b7058-4a33-47d2-8fc0-5a4e98d13bd3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:57 devstack sudo[91909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b
Nov 05 11:55:57 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:57 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" returned: 0 in 0.681s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:58 devstack sudo[91914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd
Nov 05 11:55:58 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:58 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd" returned: 0 in 0.412s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:58 devstack sudo[91919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd
Nov 05 11:55:58 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:58 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b.ea0053a1-0a7b-4848-b7cc-a26070fb46cd" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-ea0053a1-0a7b-4848-b7cc-a26070fb46cd" released by "_delete_snapshot" :: held 2.002s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.240s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.970s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1135426009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984c12bf-af7c-41f7-ba6b-92e0348a58f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c486c006d34f4a1fbe03299c16abe6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:43Z,use_quota=True,user_id='bb566031457b4031866321d03baf5a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Creating volume 984c12bf-af7c-41f7-ba6b-92e0348a58f2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:55:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:55:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:58 devstack sudo[91922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 1073741824
Nov 05 11:55:58 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-728c404b-0722-4d61-99dc-d6ec228516ee tempest-GroupsV314Test-797193814 None] Create group from source-group-1b0a6c07-8188-4a22-8dd8-8addabafadfb completed successfully.
Nov 05 11:55:59 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 1073741824" returned: 0 in 0.532s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:59 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2
Nov 05 11:55:59 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:59 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2" returned: 0 in 0.314s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Attempting download of 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 984c12bf-af7c-41f7-ba6b-92e0348a58f2. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a99ad-720d-4c02-893c-fe0586d6d2c4]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_f7_u4ym0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:59 devstack sudo[91931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_f7_u4ym0
Nov 05 11:55:59 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:00 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_f7_u4ym0" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_f7_u4ym0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:00 devstack sudo[91935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_f7_u4ym0
Nov 05 11:56:00 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:00 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_f7_u4ym0" returned: 1 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_f7_u4ym0' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e7ca7-e69b-4ace-b079-024865b777c1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Acquiring lock "cinder-quobyte-9fe63edd-f802-4abf-8fd8-f22f36f60672" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-9fe63edd-f802-4abf-8fd8-f22f36f60672" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:00 devstack sudo[91940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD
Nov 05 11:56:00 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e61249-7af1-4753-96bb-9ae843649c2b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:01 devstack sudo[91942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672
Nov 05 11:56:01 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:01 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD" returned: 0 in 0.584s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:01 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] 97690ee3-6eec-4469-b729-e1fcbb2cb426 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 11:56:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:01 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2
Nov 05 11:56:01 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:01 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672" returned: 0 in 0.584s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:01 devstack sudo[91954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672
Nov 05 11:56:01 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:01 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9fe63edd-f802-4abf-8fd8-f22f36f60672" returned: 0 in 0.368s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-9fe63edd-f802-4abf-8fd8-f22f36f60672" released by "delete_volume" :: held 1.033s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Created reservations ['0140f001-473c-4ddb-b8be-59f0bba949e4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:02 devstack cinder-volume[87184]: WARNING cinder.quota [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-245721798 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-245721798, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:56:02 devstack cinder-volume[87184]: WARNING cinder.quota [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-245721798 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-245721798, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Created reservations ['d5048900-9ee1-44f9-91ce-3df2cf99e9d2', '1b21307f-6347-4b6b-bc6c-6de5b783e97d', 'd0aabc5f-9200-4015-ade6-7f5dc1bfb06f', '1c1a92cd-33c8-4f37-8c51-0b180ab98cc5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:02 devstack sudo[91962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:56:02 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:02 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-99de0c34-f3d2-45f9-90c0-3099e4616e9a tempest-GroupsV314Test-797193814 None] Delete group completed successfully.
Nov 05 11:56:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Acquiring lock "cinder-quobyte-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e78f047-2623-4fb0-aca4-8381e5260d81]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:03 devstack sudo[91970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b
Nov 05 11:56:03 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:03 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2" returned: 0 in 2.589s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:03 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yq3so9w0devstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:56:03 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Converted 112.00 MB image at 43.23 MB/s
Nov 05 11:56:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:03 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 1G
Nov 05 11:56:03 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:04 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" returned: 0 in 0.517s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:04 devstack sudo[91979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b
Nov 05 11:56:04 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:04 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 1G" returned: 0 in 0.412s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Downloaded image 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 984c12bf-af7c-41f7-ba6b-92e0348a58f2 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 for user bb566031457b4031866321d03baf5a06 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Marking volume 984c12bf-af7c-41f7-ba6b-92e0348a58f2 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Copying metadata from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 to 984c12bf-af7c-41f7-ba6b-92e0348a58f2. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Creating volume glance metadata for volume 984c12bf-af7c-41f7-ba6b-92e0348a58f2 backed by image 97690ee3-6eec-4469-b729-e1fcbb2cb426 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181adf33-b543-4239-bd49-1e23a49be96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104543ba780>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6c65a7-7b49-4f4a-a37c-94b9b614e6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Volume volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 (984c12bf-af7c-41f7-ba6b-92e0348a58f2): created successfully
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6c65a7-7b49-4f4a-a37c-94b9b614e6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:04 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Flow 'volume_create_manager' (7443aec7-9d9c-4504-9f95-64c442e6f185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Lock "cinder-quobyte-b4ec811c-b34c-4dce-9a6a-208c50d4bf9b" released by "delete_volume" :: held 0.894s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-393aa7fe-2891-4c5d-8234-ab6335dc5d37 tempest-ServerActionsTestOtherA-1727747723 None] Created volume successfully.
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Created reservations ['6a5a6a7e-38f2-4e06-878b-b44e2c6ea2a0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Created reservations ['2dfc38fb-3c52-469c-bacd-7549a4c8f913', '3514276c-ced2-46ff-9673-ab39897e7967', '5b313d19-1b57-41fe-8b64-0b096e68d812', 'af0c5cd8-d0b5-4838-baa8-9cc752bc1819'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:04 devstack sudo[91984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:56:04 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:05 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9f3de7b9-d90f-42bb-ab0f-819e22d9b28f tempest-GroupsV314Test-797193814 None] Delete group completed successfully.
Nov 05 11:56:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-bdbfdf8d-67e1-40c4-91f3-0e76d5277fec req-9f969b8c-97e5-4416-a7b7-31f08a54aed7 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-bdbfdf8d-67e1-40c4-91f3-0e76d5277fec req-9f969b8c-97e5-4416-a7b7-31f08a54aed7 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-bdbfdf8d-67e1-40c4-91f3-0e76d5277fec req-9f969b8c-97e5-4416-a7b7-31f08a54aed7 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-bdbfdf8d-67e1-40c4-91f3-0e76d5277fec req-9f969b8c-97e5-4416-a7b7-31f08a54aed7 tempest-ServerActionsTestOtherA-1727747723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da13e091-db87-464a-b3c4-1bf5c4748b9b', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:56:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-bdbfdf8d-67e1-40c4-91f3-0e76d5277fec req-9f969b8c-97e5-4416-a7b7-31f08a54aed7 tempest-ServerActionsTestOtherA-1727747723 None] attachment_update completed successfully.
Nov 05 11:56:18 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=29,cinder:SELECT=30,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:56:18 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=31,cinder:SELECT=34,cinder:INSERT=10 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:56:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Acquiring lock "cinder-598ac4e9-07da-49ef-b2ee-cd69ca633c59-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "cinder-598ac4e9-07da-49ef-b2ee-cd69ca633c59-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Acquiring lock "cinder-quobyte-598ac4e9-07da-49ef-b2ee-cd69ca633c59" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "cinder-quobyte-598ac4e9-07da-49ef-b2ee-cd69ca633c59" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb91b74-a38a-4c69-b872-0a5077fcb72c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:24 devstack sudo[92502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59
Nov 05 11:56:24 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:24 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59" returned: 0 in 0.617s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:24 devstack sudo[92516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59
Nov 05 11:56:24 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:25 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-598ac4e9-07da-49ef-b2ee-cd69ca633c59" returned: 0 in 0.612s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "cinder-quobyte-598ac4e9-07da-49ef-b2ee-cd69ca633c59" released by "delete_volume" :: held 1.351s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Created reservations ['cb56bf2d-4497-4b56-94eb-683442d82c18', 'ac4418d6-f27a-409a-8687-6b487c91500a', 'e27520b7-62b6-4d05-83bf-77552e4dfd66', 'ae789c26-f3a6-4843-9e22-5e771dd0c619'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:25 devstack sudo[92524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:56:25 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:26 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:26 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Deleted volume successfully.
Nov 05 11:56:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab1b7b9e-0447-4ff1-a820-8370d05aa124 tempest-AttachVolumeShelveTestJSON-87319608 None] Lock "cinder-598ac4e9-07da-49ef-b2ee-cd69ca633c59-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:35 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=10,cinder:SELECT=2,cinder:INSERT=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:56:36 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:56:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e0a7f031-6007-47d0-858b-b036d39642f5 req-a44cfee3-e3b4-4be3-9042-3b90d092cd73 tempest-ServerActionsTestOtherA-1727747723 None] Terminate volume connection completed successfully.
Nov 05 11:56:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e0a7f031-6007-47d0-858b-b036d39642f5 req-a44cfee3-e3b4-4be3-9042-3b90d092cd73 tempest-ServerActionsTestOtherA-1727747723 None] Deleting attachment da13e091-db87-464a-b3c4-1bf5c4748b9b. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:56:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e0a7f031-6007-47d0-858b-b036d39642f5 req-deee6f57-9b67-465f-aa45-f3bd224f83f2 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e0a7f031-6007-47d0-858b-b036d39642f5 req-deee6f57-9b67-465f-aa45-f3bd224f83f2 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e0a7f031-6007-47d0-858b-b036d39642f5 req-deee6f57-9b67-465f-aa45-f3bd224f83f2 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e0a7f031-6007-47d0-858b-b036d39642f5 req-deee6f57-9b67-465f-aa45-f3bd224f83f2 tempest-ServerActionsTestOtherA-1727747723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '527ef0d8-0cdc-4d72-9d1a-b06eda04fbb7', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:56:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e0a7f031-6007-47d0-858b-b036d39642f5 req-deee6f57-9b67-465f-aa45-f3bd224f83f2 tempest-ServerActionsTestOtherA-1727747723 None] attachment_update completed successfully.
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Flow 'volume_create_manager' (36bbe1dc-17c5-4a7f-a897-c943a892979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf96c96-cdf8-4afa-9387-69bb671d78f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf96c96-cdf8-4afa-9387-69bb671d78f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2104307822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3d1b4a-3435-4545-b496-030f939189db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0220559124cc4ca283d48739745a4753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:46Z,use_quota=True,user_id='caa45fed6052484c9a19f5d53161b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e37a48-df35-49db-9055-e66e077cb626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e37a48-df35-49db-9055-e66e077cb626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f7dea-81dd-4778-99ac-ea4e99f0f177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f7dea-81dd-4778-99ac-ea4e99f0f177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3d1b4a-3435-4545-b496-030f939189db', 'volume_name': 'volume-dc3d1b4a-3435-4545-b496-030f939189db', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4327d1-4b62-4b64-909e-ecb3a05102c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4327d1-4b62-4b64-909e-ecb3a05102c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1e72b4-bfba-47ec-92bc-742b8894a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Volume dc3d1b4a-3435-4545-b496-030f939189db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3d1b4a-3435-4545-b496-030f939189db', 'volume_size': 1}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2104307822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3d1b4a-3435-4545-b496-030f939189db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0220559124cc4ca283d48739745a4753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:46Z,use_quota=True,user_id='caa45fed6052484c9a19f5d53161b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Creating volume dc3d1b4a-3435-4545-b496-030f939189db {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:45 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:56:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:45 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db 1073741824
Nov 05 11:56:45 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:46 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db 1073741824" returned: 0 in 1.027s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:47 devstack sudo[93223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db
Nov 05 11:56:47 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:47 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db" returned: 0 in 0.522s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1e72b4-bfba-47ec-92bc-742b8894a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3d1b4a-3435-4545-b496-030f939189db', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a513abff-c77e-45cb-ba71-1d9b5536b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Volume volume-dc3d1b4a-3435-4545-b496-030f939189db (dc3d1b4a-3435-4545-b496-030f939189db): created successfully
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a513abff-c77e-45cb-ba71-1d9b5536b81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Flow 'volume_create_manager' (36bbe1dc-17c5-4a7f-a897-c943a892979a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6e780d9d-83fb-4bbe-af70-2cd5e336a23c tempest-VolumeQuotasAdminTestJSON-642385695 None] Created volume successfully.
Nov 05 11:56:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Acquiring lock "cinder-dc3d1b4a-3435-4545-b496-030f939189db-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "cinder-dc3d1b4a-3435-4545-b496-030f939189db-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Acquiring lock "cinder-quobyte-dc3d1b4a-3435-4545-b496-030f939189db" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "cinder-quobyte-dc3d1b4a-3435-4545-b496-030f939189db" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef93443f-73a8-488a-984d-208e5b5b537e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:48 devstack sudo[93261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db
Nov 05 11:56:48 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:49 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db" returned: 0 in 0.833s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:49 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db
Nov 05 11:56:49 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:49 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dc3d1b4a-3435-4545-b496-030f939189db" returned: 0 in 0.630s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "cinder-quobyte-dc3d1b4a-3435-4545-b496-030f939189db" released by "delete_volume" :: held 1.624s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Created reservations ['4431fd21-3591-40e3-b9c3-629429d49aaa', '6a0864d2-addd-41ba-a10f-dd656d97e6db', '3bd18001-560f-4dc6-a081-42d66c2b6a22', '2ab313f6-c338-49ee-90c5-7236c3139634'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:50 devstack sudo[93313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:56:50 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:51 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 1.028s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:51 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Deleted volume successfully.
Nov 05 11:56:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abfb2f03-ad6d-49b5-afbc-a38d6c0b06c4 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "cinder-dc3d1b4a-3435-4545-b496-030f939189db-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Flow 'volume_create_manager' (c865e50b-f289-4ef3-9706-d482429123e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7acdeb-3ba9-4fd1-98e9-8c6df0dba33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7acdeb-3ba9-4fd1-98e9-8c6df0dba33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-834410624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c66bba8-417f-4332-b510-a79d5b1418ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0220559124cc4ca283d48739745a4753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:53Z,use_quota=True,user_id='caa45fed6052484c9a19f5d53161b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422bea90-5257-4e7d-980a-175f942cff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422bea90-5257-4e7d-980a-175f942cff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebde440d-62d4-4f40-832d-4ed31a9bd777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebde440d-62d4-4f40-832d-4ed31a9bd777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c66bba8-417f-4332-b510-a79d5b1418ec', 'volume_name': 'volume-8c66bba8-417f-4332-b510-a79d5b1418ec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cdce00-b53e-434c-a39c-60d69e5813ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cdce00-b53e-434c-a39c-60d69e5813ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0015e3fd-6ad8-461c-8a78-d99b48767926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Volume 8c66bba8-417f-4332-b510-a79d5b1418ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c66bba8-417f-4332-b510-a79d5b1418ec', 'volume_size': 1}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-834410624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c66bba8-417f-4332-b510-a79d5b1418ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0220559124cc4ca283d48739745a4753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:53Z,use_quota=True,user_id='caa45fed6052484c9a19f5d53161b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Creating volume 8c66bba8-417f-4332-b510-a79d5b1418ec {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:52 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:56:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:52 devstack sudo[93319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec 1073741824
Nov 05 11:56:52 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:54 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec 1073741824" returned: 0 in 1.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:54 devstack sudo[93325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec
Nov 05 11:56:54 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:55 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec" returned: 0 in 0.899s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0015e3fd-6ad8-461c-8a78-d99b48767926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c66bba8-417f-4332-b510-a79d5b1418ec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d0240e-569d-4e78-8e6d-cc72f0b49da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Volume volume-8c66bba8-417f-4332-b510-a79d5b1418ec (8c66bba8-417f-4332-b510-a79d5b1418ec): created successfully
Nov 05 11:56:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d0240e-569d-4e78-8e6d-cc72f0b49da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Flow 'volume_create_manager' (c865e50b-f289-4ef3-9706-d482429123e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e2df6057-51ea-4a55-9877-d5de1e77c407 tempest-VolumeQuotasAdminTestJSON-642385695 None] Created volume successfully.
Nov 05 11:56:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0d836b3c-63b2-43e2-a3f8-5a5136290b58 tempest-VolumeQuotasAdminTestJSON-241256421 None] Transfer volume completed successfully.
Nov 05 11:56:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Acquiring lock "cinder-8c66bba8-417f-4332-b510-a79d5b1418ec-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Lock "cinder-8c66bba8-417f-4332-b510-a79d5b1418ec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Acquiring lock "cinder-quobyte-8c66bba8-417f-4332-b510-a79d5b1418ec" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Lock "cinder-quobyte-8c66bba8-417f-4332-b510-a79d5b1418ec" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[128bdcf6-53b8-4091-8773-7161b6ed163d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:59 devstack sudo[93355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec
Nov 05 11:56:59 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:59 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec" returned: 0 in 0.582s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:59 devstack sudo[93362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec
Nov 05 11:56:59 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:59 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c66bba8-417f-4332-b510-a79d5b1418ec" returned: 0 in 0.346s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Lock "cinder-quobyte-8c66bba8-417f-4332-b510-a79d5b1418ec" released by "delete_volume" :: held 1.031s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Created reservations ['9c0ffa08-0a43-43c7-a3f4-a47fb3912e51', '88c72d4b-cc12-4115-a9a7-41ac7f8bda28', 'a9bed89a-364c-494e-b919-94a94c371d20', '6e0893f7-de90-462a-a979-d3ba4ae93c9f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:00 devstack sudo[93365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:00 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:00 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.375s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Deleted volume successfully.
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b964333-73d5-4a94-aa7a-20481dc3d6fb tempest-VolumeQuotasAdminTestJSON-1319956366 None] Lock "cinder-8c66bba8-417f-4332-b510-a79d5b1418ec-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Flow 'volume_create_manager' (d45ee58c-40d5-45b7-ae01-3c69dbf411f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74673836-725a-473f-83bf-9e32f3ef6f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74673836-725a-473f-83bf-9e32f3ef6f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-302942594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b1558a-4074-47a1-85f5-e66730d70e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826d429773324b54a0b17619470d378c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:01Z,use_quota=True,user_id='fa5f95311d6942cebf8560bac1c000d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f632a83e-6cec-4461-b018-a7b2a69bdbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f632a83e-6cec-4461-b018-a7b2a69bdbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c735b-bd40-4f7d-8f9a-3a415ce9cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c735b-bd40-4f7d-8f9a-3a415ce9cb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b1558a-4074-47a1-85f5-e66730d70e69', 'volume_name': 'volume-a1b1558a-4074-47a1-85f5-e66730d70e69', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1272e81f-c0dc-4c8c-b8c9-204860c638d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1272e81f-c0dc-4c8c-b8c9-204860c638d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12958027-1ef8-4fff-bcfa-ccdd4bf9812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Volume a1b1558a-4074-47a1-85f5-e66730d70e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b1558a-4074-47a1-85f5-e66730d70e69', 'volume_size': 1}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-302942594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b1558a-4074-47a1-85f5-e66730d70e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826d429773324b54a0b17619470d378c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:01Z,use_quota=True,user_id='fa5f95311d6942cebf8560bac1c000d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Creating volume a1b1558a-4074-47a1-85f5-e66730d70e69 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:01 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:01 devstack sudo[93368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69 1073741824
Nov 05 11:57:01 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:01 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69 1073741824" returned: 0 in 0.604s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:01 devstack sudo[93373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69
Nov 05 11:57:01 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:02 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12958027-1ef8-4fff-bcfa-ccdd4bf9812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b1558a-4074-47a1-85f5-e66730d70e69', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07b0c63-b498-4641-8f87-da46a1dd3a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Volume volume-a1b1558a-4074-47a1-85f5-e66730d70e69 (a1b1558a-4074-47a1-85f5-e66730d70e69): created successfully
Nov 05 11:57:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07b0c63-b498-4641-8f87-da46a1dd3a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Flow 'volume_create_manager' (d45ee58c-40d5-45b7-ae01-3c69dbf411f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4335f1a1-f374-4de3-929d-0a39501a09ce tempest-ServersNegativeTestJSON-733168368 None] Created volume successfully.
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Flow 'volume_create_manager' (e0630d52-f2ec-439a-9003-26a76cbdfdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e337087-f359-4697-8b1b-e012061f9985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e337087-f359-4697-8b1b-e012061f9985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-992147994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4054160e-0f5f-4378-b44d-bb98658d7719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826d429773324b54a0b17619470d378c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:07Z,use_quota=True,user_id='fa5f95311d6942cebf8560bac1c000d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dd7243-0bf2-4075-8db2-02a523abaa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dd7243-0bf2-4075-8db2-02a523abaa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857e2088-6f51-4ebe-b3fa-b18ffdcf6811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857e2088-6f51-4ebe-b3fa-b18ffdcf6811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4054160e-0f5f-4378-b44d-bb98658d7719', 'volume_name': 'volume-4054160e-0f5f-4378-b44d-bb98658d7719', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c8a76f-d066-4f6e-aed4-b41700d078e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c8a76f-d066-4f6e-aed4-b41700d078e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897edaf6-6557-42d5-97c8-2bfff4f981b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Volume 4054160e-0f5f-4378-b44d-bb98658d7719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4054160e-0f5f-4378-b44d-bb98658d7719', 'volume_size': 1}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-992147994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4054160e-0f5f-4378-b44d-bb98658d7719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826d429773324b54a0b17619470d378c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:07Z,use_quota=True,user_id='fa5f95311d6942cebf8560bac1c000d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Creating volume 4054160e-0f5f-4378-b44d-bb98658d7719 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:07 devstack sudo[93407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719 1073741824
Nov 05 11:57:07 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:07 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719 1073741824" returned: 0 in 0.626s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:07 devstack sudo[93413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719
Nov 05 11:57:07 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:08 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897edaf6-6557-42d5-97c8-2bfff4f981b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4054160e-0f5f-4378-b44d-bb98658d7719', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850dccb4-cf20-4eaf-9749-ddba72eb064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Volume volume-4054160e-0f5f-4378-b44d-bb98658d7719 (4054160e-0f5f-4378-b44d-bb98658d7719): created successfully
Nov 05 11:57:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850dccb4-cf20-4eaf-9749-ddba72eb064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Flow 'volume_create_manager' (e0630d52-f2ec-439a-9003-26a76cbdfdfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2a52839a-a58d-4d8d-8e7c-6dbea81ecfb4 tempest-ServersNegativeTestJSON-733168368 None] Created volume successfully.
Nov 05 11:57:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "cinder-4054160e-0f5f-4378-b44d-bb98658d7719-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-4054160e-0f5f-4378-b44d-bb98658d7719-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "cinder-quobyte-4054160e-0f5f-4378-b44d-bb98658d7719" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-quobyte-4054160e-0f5f-4378-b44d-bb98658d7719" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc59ad-50ee-4355-9ec2-ab995d372f2e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:09 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719
Nov 05 11:57:09 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:10 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:10 devstack sudo[93421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719
Nov 05 11:57:10 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:10 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4054160e-0f5f-4378-b44d-bb98658d7719" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-quobyte-4054160e-0f5f-4378-b44d-bb98658d7719" released by "delete_volume" :: held 0.849s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Created reservations ['4a2342c4-cd44-4bba-ac93-b5d0511f4e8b', '6b2c7c9c-2429-462b-b029-c6f101ad437f', 'f67a552c-9f26-4b13-8cd0-e7bfc5c1fb1f', '06a44e9e-dee2-4b28-913a-a9737957bb34'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:10 devstack sudo[93427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:10 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "cinder-a1b1558a-4074-47a1-85f5-e66730d70e69-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-a1b1558a-4074-47a1-85f5-e66730d70e69-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "cinder-quobyte-a1b1558a-4074-47a1-85f5-e66730d70e69" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-quobyte-a1b1558a-4074-47a1-85f5-e66730d70e69" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[271ab1a2-01f6-41da-b7a0-481675704e86]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:11 devstack sudo[93429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69
Nov 05 11:57:11 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:11 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.430s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Deleted volume successfully.
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-90b0761f-5c9d-4432-8092-32d60ea47cd5 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-4054160e-0f5f-4378-b44d-bb98658d7719-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:11 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69" returned: 0 in 0.492s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:11 devstack sudo[93436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69
Nov 05 11:57:11 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:11 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a1b1558a-4074-47a1-85f5-e66730d70e69" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-quobyte-a1b1558a-4074-47a1-85f5-e66730d70e69" released by "delete_volume" :: held 0.925s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Created reservations ['5730a04d-95b9-48c6-beb5-38fe0837cce6', '013b6ce3-0507-45b6-a333-ceada6e69d70', '86ea5f6c-b645-46bb-adbd-0aeb0aa545a3', 'a4e22f61-ea4a-41bc-9f01-8f31a8e27570'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:12 devstack sudo[93439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:12 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:12 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Deleted volume successfully.
Nov 05 11:57:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-254450aa-57d5-45ea-bf2a-026f24581011 tempest-ServersNegativeTestJSON-733168368 None] Lock "cinder-a1b1558a-4074-47a1-85f5-e66730d70e69-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Flow 'volume_create_manager' (de438f53-823e-42cd-80c7-cf8ce62ac51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d763a8-bef5-400e-a010-8c7630f9f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d763a8-bef5-400e-a010-8c7630f9f535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-103604655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f3e34c-01de-4de1-85fd-da6053a175d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b040c13f28492bbd008868a60cb235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:13Z,use_quota=True,user_id='2ddb9db6f3db4ba2a92f7db40ad0e1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba22c972-0a60-4258-ad8e-851952a06534),volume_type_id=ba22c972-0a60-4258-ad8e-851952a06534)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5826d0ad-8f09-4b8c-8d77-c52fddfdb0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5826d0ad-8f09-4b8c-8d77-c52fddfdb0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a07995-04c4-4feb-812f-c1d3941a0de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a07995-04c4-4feb-812f-c1d3941a0de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f3e34c-01de-4de1-85fd-da6053a175d9', 'volume_name': 'volume-76f3e34c-01de-4de1-85fd-da6053a175d9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9186abbf-ca97-4204-9c1e-c2f23393cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9186abbf-ca97-4204-9c1e-c2f23393cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28bddd8-b73a-4acb-a857-1372ca1b3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Volume 76f3e34c-01de-4de1-85fd-da6053a175d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f3e34c-01de-4de1-85fd-da6053a175d9', 'volume_size': 1}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-103604655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f3e34c-01de-4de1-85fd-da6053a175d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b040c13f28492bbd008868a60cb235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:13Z,use_quota=True,user_id='2ddb9db6f3db4ba2a92f7db40ad0e1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba22c972-0a60-4258-ad8e-851952a06534),volume_type_id=ba22c972-0a60-4258-ad8e-851952a06534)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Creating volume 76f3e34c-01de-4de1-85fd-da6053a175d9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:13 devstack sudo[93453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9 1073741824
Nov 05 11:57:13 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:14 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9 1073741824" returned: 0 in 1.052s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:14 devstack sudo[93480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9
Nov 05 11:57:14 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:14 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28bddd8-b73a-4acb-a857-1372ca1b3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f3e34c-01de-4de1-85fd-da6053a175d9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f67697-69ba-4644-8495-33514553b01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Volume volume-76f3e34c-01de-4de1-85fd-da6053a175d9 (76f3e34c-01de-4de1-85fd-da6053a175d9): created successfully
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f67697-69ba-4644-8495-33514553b01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Flow 'volume_create_manager' (de438f53-823e-42cd-80c7-cf8ce62ac51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2a4c1747-8eb5-4c1f-8d8a-80b4c46b3d47 tempest-VolumeTypesAccessTest-2059999401 None] Created volume successfully.
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Acquiring lock "cinder-76f3e34c-01de-4de1-85fd-da6053a175d9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Lock "cinder-76f3e34c-01de-4de1-85fd-da6053a175d9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Acquiring lock "cinder-quobyte-76f3e34c-01de-4de1-85fd-da6053a175d9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Lock "cinder-quobyte-76f3e34c-01de-4de1-85fd-da6053a175d9" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[164bed3c-1a24-476f-9343-1615b6542028]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:15 devstack sudo[93489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9
Nov 05 11:57:15 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:15 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9" returned: 0 in 0.557s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:15 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9
Nov 05 11:57:15 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:16 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76f3e34c-01de-4de1-85fd-da6053a175d9" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Lock "cinder-quobyte-76f3e34c-01de-4de1-85fd-da6053a175d9" released by "delete_volume" :: held 1.107s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:16 devstack cinder-volume[87184]: WARNING cinder.quota [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2136577029 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2136577029, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:57:16 devstack cinder-volume[87184]: WARNING cinder.quota [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2136577029 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2136577029, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Created reservations ['0db4e061-e93a-4c5f-994b-7ebe6d113822', '93d3ab52-0605-491e-9da0-ba911c059e48', 'a82a0092-ea3c-4ad7-832c-cd94546cbccd', '2fe4c262-f218-49e1-b632-c3f33a30c689'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:16 devstack sudo[93515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:16 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:17 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Deleted volume successfully.
Nov 05 11:57:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66b26775-eb84-4417-96ca-df7da710b0c2 tempest-VolumeTypesAccessTest-2059999401 None] Lock "cinder-76f3e34c-01de-4de1-85fd-da6053a175d9-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:26 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=41,cinder:UPDATE=63,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=45,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=8 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:57:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-c52d6e5e-033a-4eb9-ad7e-6eb6a7c56726 tempest-ServerActionsTestOtherA-1727747723 None] Terminate volume connection completed successfully.
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-c52d6e5e-033a-4eb9-ad7e-6eb6a7c56726 tempest-ServerActionsTestOtherA-1727747723 None] Deleting attachment 527ef0d8-0cdc-4d72-9d1a-b06eda04fbb7. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "cinder-984c12bf-af7c-41f7-ba6b-92e0348a58f2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-984c12bf-af7c-41f7-ba6b-92e0348a58f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "cinder-quobyte-984c12bf-af7c-41f7-ba6b-92e0348a58f2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-quobyte-984c12bf-af7c-41f7-ba6b-92e0348a58f2" acquired by "delete_volume" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f921beb-a265-4eb7-a6da-766be80a2848]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:27 devstack sudo[93624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2
Nov 05 11:57:27 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:28 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2" returned: 0 in 0.691s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:28 devstack sudo[93631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2
Nov 05 11:57:28 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:28 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-984c12bf-af7c-41f7-ba6b-92e0348a58f2" returned: 0 in 0.469s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-quobyte-984c12bf-af7c-41f7-ba6b-92e0348a58f2" released by "delete_volume" :: held 1.268s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:28 devstack cinder-volume[87184]: DEBUG cinder.quota [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Created reservations ['3015724c-d005-4c79-bafe-222013489d45', '449c05d1-e9b8-4415-80f2-b2d5e62d7da6', '194acd7a-aa1a-4972-8760-a83ba83f8a04', '3ba8a57a-4258-48f5-af3d-048eb231b5e1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:29 devstack sudo[93636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:29 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:29 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG cinder.manager [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Deleted volume successfully.
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-60b04520-e041-42c8-94a2-2b9a075b9a59 req-2506db32-c95d-4164-b76e-5ee1c2783f2a tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-984c12bf-af7c-41f7-ba6b-92e0348a58f2-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "cinder-b2db35d5-4059-4f70-b591-f45dd97e41e9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-b2db35d5-4059-4f70-b591-f45dd97e41e9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "cinder-quobyte-b2db35d5-4059-4f70-b591-f45dd97e41e9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-quobyte-b2db35d5-4059-4f70-b591-f45dd97e41e9" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c306e6d-34dd-43db-97a3-53df9550ce75]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:30 devstack sudo[93639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9
Nov 05 11:57:30 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:30 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9" returned: 0 in 0.517s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:30 devstack sudo[93644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9
Nov 05 11:57:30 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:30 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b2db35d5-4059-4f70-b591-f45dd97e41e9" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-quobyte-b2db35d5-4059-4f70-b591-f45dd97e41e9" released by "delete_volume" :: held 0.893s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Created reservations ['fc08c4a7-5e8a-4707-8e4b-d7fc7964d6a2', '3b90fe7a-57d0-4384-9a76-ab3391e20992', '0959b2e8-e30a-4721-ba44-3b6cf0cd9700', '8aeee103-7b4f-40f1-b84d-5b6d4f87b05d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:31 devstack sudo[93647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:31 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:31 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Deleted volume successfully.
Nov 05 11:57:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24a98a5d-8d32-41f8-9e30-4154475f0e20 tempest-ServerActionsTestOtherA-1727747723 None] Lock "cinder-b2db35d5-4059-4f70-b591-f45dd97e41e9-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Flow 'volume_create_manager' (4daf6ed7-5b6e-4369-8409-57ea243e181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904de953-7641-4762-a374-b5aec1eaf9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904de953-7641-4762-a374-b5aec1eaf9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1588317938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5b3d3-6480-419f-a710-cf812f75d4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c9e12659fb472da48c1567ea55ba3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:35Z,use_quota=True,user_id='b27a173feee4459f810054543f867820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec93bda-072f-47e5-9467-9c8cfe29875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec93bda-072f-47e5-9467-9c8cfe29875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64f4a2c-1380-4f3c-85f1-3aadcb53aaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64f4a2c-1380-4f3c-85f1-3aadcb53aaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a5b3d3-6480-419f-a710-cf812f75d4e8', 'volume_name': 'volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496629ea-78cf-4bf1-be31-db9f8f32187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496629ea-78cf-4bf1-be31-db9f8f32187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61791978-6c9a-4312-8560-5f74e89b6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Volume d7a5b3d3-6480-419f-a710-cf812f75d4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8', 'volume_size': 1}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1588317938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5b3d3-6480-419f-a710-cf812f75d4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c9e12659fb472da48c1567ea55ba3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:35Z,use_quota=True,user_id='b27a173feee4459f810054543f867820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Creating volume d7a5b3d3-6480-419f-a710-cf812f75d4e8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:34 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:34 devstack sudo[93701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8 1073741824
Nov 05 11:57:34 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:35 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8 1073741824" returned: 0 in 0.534s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:35 devstack sudo[93707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8
Nov 05 11:57:35 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:35 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8" returned: 0 in 0.368s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61791978-6c9a-4312-8560-5f74e89b6edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c4e49d-2754-446d-ad34-036d1d9e6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Volume volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8 (d7a5b3d3-6480-419f-a710-cf812f75d4e8): created successfully
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c4e49d-2754-446d-ad34-036d1d9e6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Flow 'volume_create_manager' (4daf6ed7-5b6e-4369-8409-57ea243e181d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0253c1f6-edc8-49d9-ae91-bd94ffdf4141 tempest-VolumesTransfersTest-1777304709 None] Created volume successfully.
Nov 05 11:57:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-532399a8-1d55-4512-8d98-4f31db3aa102 tempest-VolumesTransfersTest-250275738 None] Transfer volume completed successfully.
Nov 05 11:57:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Acquiring lock "cinder-d7a5b3d3-6480-419f-a710-cf812f75d4e8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-d7a5b3d3-6480-419f-a710-cf812f75d4e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Acquiring lock "cinder-quobyte-d7a5b3d3-6480-419f-a710-cf812f75d4e8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-quobyte-d7a5b3d3-6480-419f-a710-cf812f75d4e8" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ec349-b3c1-47ef-adcc-bbc5bf062ead]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:39 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8
Nov 05 11:57:39 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-51b8d5fc-f6cc-4705-a2c3-29a32d6870f5 tempest-GroupSnapshotsTest-1538346861 None] Group tempest-GroupSnapshotsTest-Group-1321994484: creating
Nov 05 11:57:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-51b8d5fc-f6cc-4705-a2c3-29a32d6870f5 tempest-GroupSnapshotsTest-1538346861 None] Group tempest-GroupSnapshotsTest-Group-1321994484: created successfully
Nov 05 11:57:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-51b8d5fc-f6cc-4705-a2c3-29a32d6870f5 tempest-GroupSnapshotsTest-1538346861 None] Create group completed successfully.
Nov 05 11:57:39 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8" returned: 0 in 0.506s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:39 devstack sudo[93716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8
Nov 05 11:57:39 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:39 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7a5b3d3-6480-419f-a710-cf812f75d4e8" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-quobyte-d7a5b3d3-6480-419f-a710-cf812f75d4e8" released by "delete_volume" :: held 0.822s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Created reservations ['5ccc57f7-da11-4778-9296-b297529b3245', '5b0b2ad7-6eca-460a-8e25-991c53d9fb08', '5cae4e98-61eb-42e1-b99f-608a3513a683', '66ecf0a5-7d62-4792-acf0-da66d7e6cae4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:39 devstack sudo[93719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:39 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:40 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Deleted volume successfully.
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64833e89-b2be-4cde-be68-0ddf99d7022e tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-d7a5b3d3-6480-419f-a710-cf812f75d4e8-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Flow 'volume_create_manager' (74721edf-68c3-41d5-8924-f6f849c8344f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf46261b-6d73-4d1d-9e39-8c50dea2aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf46261b-6d73-4d1d-9e39-8c50dea2aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1221328843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f23a849-4d84-40b1-9140-5ae154bdbe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c9e12659fb472da48c1567ea55ba3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:41Z,use_quota=True,user_id='b27a173feee4459f810054543f867820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3b9eb4-f30f-43c8-bcb7-36673453b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3b9eb4-f30f-43c8-bcb7-36673453b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f5f783-fa8e-4b98-8208-7bb1256f3196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f5f783-fa8e-4b98-8208-7bb1256f3196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f23a849-4d84-40b1-9140-5ae154bdbe5d', 'volume_name': 'volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62765de-6ec6-4717-a2f7-0e4c036b7c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62765de-6ec6-4717-a2f7-0e4c036b7c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c015f1-56ad-44a1-9284-d4807aeb29c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Volume 7f23a849-4d84-40b1-9140-5ae154bdbe5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d', 'volume_size': 1}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1221328843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f23a849-4d84-40b1-9140-5ae154bdbe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c9e12659fb472da48c1567ea55ba3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:41Z,use_quota=True,user_id='b27a173feee4459f810054543f867820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Creating volume 7f23a849-4d84-40b1-9140-5ae154bdbe5d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:40 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:40 devstack sudo[93737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d 1073741824
Nov 05 11:57:40 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (7090149e-e5fd-48c0-be2d-c53eac4d25b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58099689-f9a5-42e9-9632-757fe91f8e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58099689-f9a5-42e9-9632-757fe91f8e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830622797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f195e721-d3d6-4e57-b876-799437305a54,host='devstack@QuobyteHD#QuobyteHD',id=2f58f084-a24f-482d-b1b3-9d2d5915ad4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:41Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f23a7ff-7ec0-4c2d-b912-c3d25b35e4cc),volume_type_id=2f23a7ff-7ec0-4c2d-b912-c3d25b35e4cc)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bbacee-03c0-4a22-9322-d4484fa0e885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bbacee-03c0-4a22-9322-d4484fa0e885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb176cca-fe17-44a3-a846-0380b360faaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb176cca-fe17-44a3-a846-0380b360faaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f58f084-a24f-482d-b1b3-9d2d5915ad4f', 'volume_name': 'volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1441af97-a321-4f22-8c8d-8f5357faae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1441af97-a321-4f22-8c8d-8f5357faae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0381bd8b-6a96-4ae5-9fee-57c85713cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Volume 2f58f084-a24f-482d-b1b3-9d2d5915ad4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f', 'volume_size': 1}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:41 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d 1073741824" returned: 0 in 0.549s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:41 devstack sudo[93743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d
Nov 05 11:57:41 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:41 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f195e721-d3d6-4e57-b876-799437305a54,created_at=2026-11-05T10:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830622797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f195e721-d3d6-4e57-b876-799437305a54,host='devstack@QuobyteHD#QuobyteHD',id=2f58f084-a24f-482d-b1b3-9d2d5915ad4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:41Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f23a7ff-7ec0-4c2d-b912-c3d25b35e4cc),volume_type_id=2f23a7ff-7ec0-4c2d-b912-c3d25b35e4cc)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Creating volume 2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:41 devstack sudo[93746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f 1073741824
Nov 05 11:57:41 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c015f1-56ad-44a1-9284-d4807aeb29c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4b8f6c-c568-42e2-ba15-15605c8f9ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Volume volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d (7f23a849-4d84-40b1-9140-5ae154bdbe5d): created successfully
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4b8f6c-c568-42e2-ba15-15605c8f9ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Flow 'volume_create_manager' (74721edf-68c3-41d5-8924-f6f849c8344f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7e831a35-5cd2-4fdb-ab65-9a62709e5244 tempest-VolumesTransfersTest-1777304709 None] Created volume successfully.
Nov 05 11:57:42 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f 1073741824" returned: 0 in 0.581s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:42 devstack sudo[93753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f
Nov 05 11:57:42 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:42 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0381bd8b-6a96-4ae5-9fee-57c85713cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069b20d3-fae8-4bd3-8f22-a66351fe92f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Volume volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f (2f58f084-a24f-482d-b1b3-9d2d5915ad4f): created successfully
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069b20d3-fae8-4bd3-8f22-a66351fe92f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (7090149e-e5fd-48c0-be2d-c53eac4d25b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8dfacb97-f6f6-4f92-b919-3ccf469d40fc tempest-GroupSnapshotsTest-1538346861 None] Created volume successfully.
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Acquiring lock "cinder-7f23a849-4d84-40b1-9140-5ae154bdbe5d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-7f23a849-4d84-40b1-9140-5ae154bdbe5d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Acquiring lock "cinder-quobyte-7f23a849-4d84-40b1-9140-5ae154bdbe5d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-quobyte-7f23a849-4d84-40b1-9140-5ae154bdbe5d" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[465be900-b497-4309-a5d0-b096039f1130]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:43 devstack sudo[93758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d
Nov 05 11:57:43 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:43 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:43 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d
Nov 05 11:57:43 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:43 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f23a849-4d84-40b1-9140-5ae154bdbe5d" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-quobyte-7f23a849-4d84-40b1-9140-5ae154bdbe5d" released by "delete_volume" :: held 0.775s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Created reservations ['23004fff-900f-4406-a621-d6dbdbd50a28', 'c79ea187-f5ec-4a35-b4fc-81d6dac0cd26', 'eb11c5cc-1f30-4d54-aa8e-e686efb36604', '75ccf6cf-8763-442c-856f-5948c239d313'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:44 devstack sudo[93766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:44 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] GroupSnapshot 317425bf-05cd-4a61-81ac-e87c3298863b: creating.
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Group snapshot 317425bf-05cd-4a61-81ac-e87c3298863b: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Creating offline snapshot 09476782-ccd8-4329-8d39-ece76b0b13e8 of volume 2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1106e15-dbe6-4268-b62b-3a471bc01ab1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:44 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Deleted volume successfully.
Nov 05 11:57:44 devstack sudo[93768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f
Nov 05 11:57:44 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71c25caf-2404-4533-93e5-185cdc49631c tempest-VolumesTransfersTest-1377966451 None] Lock "cinder-7f23a849-4d84-40b1-9140-5ae154bdbe5d-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:44 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" returned: 0 in 0.405s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:44 devstack sudo[93775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 1G
Nov 05 11:57:44 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:45 devstack sudo[93782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:57:45 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:45 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:45 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 1G" returned: 0 in 0.747s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:45 devstack sudo[93785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8
Nov 05 11:57:45 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Flow 'volume_create_manager' (a8488815-b68f-4858-8182-db60ded88cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8876f5ff-4173-4d62-ae30-620507592be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8876f5ff-4173-4d62-ae30-620507592be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-123230605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c42166bdec64372abf3f80b866a48c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:46Z,use_quota=True,user_id='1833afd056484ae69e27836f808b4446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282814a7-1f7a-4422-bb38-ef6359fe73d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282814a7-1f7a-4422-bb38-ef6359fe73d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383be36b-dc85-4448-b2a2-e01435c0f22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383be36b-dc85-4448-b2a2-e01435c0f22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5', 'volume_name': 'volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f45844b-2418-4099-9abc-08a984cb41d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f45844b-2418-4099-9abc-08a984cb41d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ecabaa-863a-4eaf-b11f-83969515ff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Volume 1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5', 'volume_size': 1}
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:45 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:45 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:57:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:46 devstack sudo[93792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8
Nov 05 11:57:46 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:46 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:46 devstack sudo[93795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.info
Nov 05 11:57:46 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:46 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.info" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:46 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:46 devstack sudo[93798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.info
Nov 05 11:57:46 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:46 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.info" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.960s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-123230605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c42166bdec64372abf3f80b866a48c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:46Z,use_quota=True,user_id='1833afd056484ae69e27836f808b4446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Creating volume 1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:46 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:46 devstack sudo[93801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 1073741824
Nov 05 11:57:46 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4fde5857-b2bf-49a3-a204-a605d40ebd52 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 317425bf-05cd-4a61-81ac-e87c3298863b: created successfully
Nov 05 11:57:47 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 1073741824" returned: 0 in 0.622s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:47 devstack sudo[93808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5
Nov 05 11:57:47 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:48 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ecabaa-863a-4eaf-b11f-83969515ff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f60b38-3065-42e8-a8f2-89f0bfaf43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Volume volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 (1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5): created successfully
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f60b38-3065-42e8-a8f2-89f0bfaf43c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Flow 'volume_create_manager' (a8488815-b68f-4858-8182-db60ded88cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b61edc83-585b-4fc7-a13e-b136d051f860 tempest-AttachVolumeNegativeTest-83723807 None] Created volume successfully.
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-09476782-ccd8-4329-8d39-ece76b0b13e8-88ffca46-9d98-41f6-b674-b9f93161eb3e" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-09476782-ccd8-4329-8d39-ece76b0b13e8-88ffca46-9d98-41f6-b674-b9f93161eb3e" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Creating volume 88ffca46-9d98-41f6-b674-b9f93161eb3e from snapshot 09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-88ffca46-9d98-41f6-b674-b9f93161eb3e" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-88ffca46-9d98-41f6-b674-b9f93161eb3e" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] snapshot: 09476782-ccd8-4329-8d39-ece76b0b13e8, volume: 88ffca46-9d98-41f6-b674-b9f93161eb3e,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce912b6-4629-44a0-960a-2f5d7f9a2134]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:49 devstack sudo[93811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8
Nov 05 11:57:49 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:49 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8" returned: 0 in 0.580s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[628fe07c-be1d-4c5d-8412-bc880d362336]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:49 devstack sudo[93821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f
Nov 05 11:57:49 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:50 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" returned: 0 in 0.606s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 11:57:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 11:57:50 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 11:57:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-166ca266-2f23-45d4-bdea-53d08d2925fc req-134b1ac6-5931-4c02-b9f9-4ddba4862619 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:50 devstack sudo[93835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e
Nov 05 11:57:50 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Flow 'volume_create_manager' (99991b78-0dde-4a81-810a-fb50163b8a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53841da3-7e0c-49ec-a09a-e7b2778887de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53841da3-7e0c-49ec-a09a-e7b2778887de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1658991685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d699d92-54fb-4821-899e-fef210ba214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454f76d0844840609f3e16a3d06f1ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:58Z,use_quota=True,user_id='eccacefdeee145a684ecfd6fa0293219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4c4e46-b227-4a7c-bc14-a42bd71fc21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4c4e46-b227-4a7c-bc14-a42bd71fc21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ec8361-e37f-4d7f-9f1a-beab05f80386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ec8361-e37f-4d7f-9f1a-beab05f80386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d699d92-54fb-4821-899e-fef210ba214f', 'volume_name': 'volume-2d699d92-54fb-4821-899e-fef210ba214f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716ef03c-a6c4-4e54-886b-87ce0d04d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716ef03c-a6c4-4e54-886b-87ce0d04d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548b6e0c-e803-435c-b82c-2342beccf272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Volume 2d699d92-54fb-4821-899e-fef210ba214f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d699d92-54fb-4821-899e-fef210ba214f', 'volume_size': 1}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:58 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e" returned: 0 in 8.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:57:58 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Converted 1024.00 MB image at 119.43 MB/s
Nov 05 11:57:58 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:57:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:58 devstack sudo[93885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e
Nov 05 11:57:58 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:59 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-88ffca46-9d98-41f6-b674-b9f93161eb3e" released by "_copy_volume_from_snapshot" :: held 10.201s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-09476782-ccd8-4329-8d39-ece76b0b13e8-88ffca46-9d98-41f6-b674-b9f93161eb3e" released by "_create_volume_from_snapshot" :: held 10.283s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.316s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-166ca266-2f23-45d4-bdea-53d08d2925fc req-134b1ac6-5931-4c02-b9f9-4ddba4862619 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.873s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-166ca266-2f23-45d4-bdea-53d08d2925fc req-134b1ac6-5931-4c02-b9f9-4ddba4862619 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1658991685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d699d92-54fb-4821-899e-fef210ba214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454f76d0844840609f3e16a3d06f1ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:58Z,use_quota=True,user_id='eccacefdeee145a684ecfd6fa0293219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Creating volume 2d699d92-54fb-4821-899e-fef210ba214f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:59 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:59 devstack sudo[93888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f 1073741824
Nov 05 11:57:59 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-166ca266-2f23-45d4-bdea-53d08d2925fc req-134b1ac6-5931-4c02-b9f9-4ddba4862619 tempest-AttachVolumeNegativeTest-83723807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66d8abb5-0af0-444c-a6b8-dc1dfcb6918b', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:57:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1f61a843-7ba7-40f7-bae0-3f64d2bac2a2 tempest-GroupSnapshotsTest-1538346861 None] Create group from source-snapshot-317425bf-05cd-4a61-81ac-e87c3298863b completed successfully.
Nov 05 11:57:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-166ca266-2f23-45d4-bdea-53d08d2925fc req-134b1ac6-5931-4c02-b9f9-4ddba4862619 tempest-AttachVolumeNegativeTest-83723807 None] attachment_update completed successfully.
Nov 05 11:57:59 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f 1073741824" returned: 0 in 0.641s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:59 devstack sudo[94309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f
Nov 05 11:57:59 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-88ffca46-9d98-41f6-b674-b9f93161eb3e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-88ffca46-9d98-41f6-b674-b9f93161eb3e" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b9b13-e51e-48be-8126-b5f097df0e7b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:00 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548b6e0c-e803-435c-b82c-2342beccf272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d699d92-54fb-4821-899e-fef210ba214f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2cba4f-0928-40d3-9d3f-287c6e1ab41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Volume volume-2d699d92-54fb-4821-899e-fef210ba214f (2d699d92-54fb-4821-899e-fef210ba214f): created successfully
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2cba4f-0928-40d3-9d3f-287c6e1ab41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Flow 'volume_create_manager' (99991b78-0dde-4a81-810a-fb50163b8a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-636e8207-fe07-478d-9e6b-3c8c2264a659 tempest-VolumesTransfersV355Test-964969685 None] Created volume successfully.
Nov 05 11:58:00 devstack sudo[94312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e
Nov 05 11:58:00 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:00 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e" returned: 0 in 0.454s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:00 devstack sudo[94318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e
Nov 05 11:58:00 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:01 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-88ffca46-9d98-41f6-b674-b9f93161eb3e" returned: 0 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-88ffca46-9d98-41f6-b674-b9f93161eb3e" released by "delete_volume" :: held 0.936s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['bcdeec49-804f-46aa-a3df-141e8f75feed'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:01 devstack cinder-volume[87184]: WARNING cinder.quota [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-710476638 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-710476638, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:01 devstack cinder-volume[87184]: WARNING cinder.quota [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-710476638 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-710476638, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['c0c7e884-dc95-4d3e-8c2b-61a577466af0', '6bf76234-b972-4551-976b-1e9e262027d2', '49ab5ce7-2493-4675-beaf-681ad936dbf7', '959a6447-1347-4730-82e1-ec7166cce579'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:01 devstack sudo[94321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:58:01 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:01 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:01 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d5672dd5-c396-4b9f-bb53-50aeca06e0a4 tempest-GroupSnapshotsTest-1538346861 None] Delete group completed successfully.
Nov 05 11:58:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6e526dc2-7c86-4bb7-b05b-9f809f3caf83 tempest-VolumesTransfersV355Test-1828159756 None] Transfer volume completed successfully.
Nov 05 11:58:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Acquiring lock "cinder-2d699d92-54fb-4821-899e-fef210ba214f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-2d699d92-54fb-4821-899e-fef210ba214f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 317425bf-05cd-4a61-81ac-e87c3298863b: deleting
Nov 05 11:58:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Acquiring lock "cinder-quobyte-2d699d92-54fb-4821-899e-fef210ba214f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 317425bf-05cd-4a61-81ac-e87c3298863b: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 11:58:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-quobyte-2d699d92-54fb-4821-899e-fef210ba214f" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af6d8b-4878-457d-bee2-653c102125cc]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-09476782-ccd8-4329-8d39-ece76b0b13e8" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-09476782-ccd8-4329-8d39-ece76b0b13e8" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Deleting offline snapshot 09476782-ccd8-4329-8d39-ece76b0b13e8 of volume 2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] snapshot_file for this snap is: volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55632379-dbb4-402a-972d-d61ab7bc4b05]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:03 devstack sudo[94324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f
Nov 05 11:58:03 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:03 devstack sudo[94325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8
Nov 05 11:58:03 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:03 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f" returned: 0 in 0.639s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:03 devstack sudo[94334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f
Nov 05 11:58:03 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:03 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8" returned: 0 in 0.564s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce8572-e1c9-4597-b8f9-611c59879307]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:03 devstack sudo[94337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f
Nov 05 11:58:03 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:04 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2d699d92-54fb-4821-899e-fef210ba214f" returned: 0 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-quobyte-2d699d92-54fb-4821-899e-fef210ba214f" released by "delete_volume" :: held 1.115s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Created reservations ['bb9e56b6-ff94-4e3c-8cd6-2972f785c2bf', 'ec5adddb-d87c-4a29-ac9e-ed3416a7a405', '89ac2097-41d8-4dae-887e-f947a81515fb', 'c6c1ed31-2f35-4c1a-82b9-7e22640eae26'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:04 devstack sudo[94342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:58:04 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:04 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" returned: 0 in 0.704s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:04 devstack sudo[94345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8
Nov 05 11:58:04 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:04 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Deleted volume successfully.
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb23fc-f272-498d-939b-9dd99120d5c9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-2d699d92-54fb-4821-899e-fef210ba214f-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:04 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:04 devstack sudo[94352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8
Nov 05 11:58:04 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:05 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f.09476782-ccd8-4329-8d39-ece76b0b13e8" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-09476782-ccd8-4329-8d39-ece76b0b13e8" released by "_delete_snapshot" :: held 2.337s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" released by "delete_snapshot" :: held 2.384s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:05 devstack cinder-volume[87184]: WARNING cinder.quota [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-710476638 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-710476638, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['6b52f397-cfd3-4bff-a407-4d4b47156f19', '29dd9fc8-5eb9-4100-9ed1-7c4360755851', '290278ff-eacd-4ad8-a9ca-eae9f2deef4d', 'd98e2513-f8c6-41ba-a30f-ef793b97b1d1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ad66c670-efe2-4994-9acc-4e86d00ce846 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 317425bf-05cd-4a61-81ac-e87c3298863b: deleted successfully
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Flow 'volume_create_manager' (b6a6ccc9-a715-475a-9a99-ff9d1a361e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0fa170-644d-4723-88b7-559e3772bdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0fa170-644d-4723-88b7-559e3772bdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1131297721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67873209-a9c5-4fd3-9503-abadd2037644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454f76d0844840609f3e16a3d06f1ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:06Z,use_quota=True,user_id='eccacefdeee145a684ecfd6fa0293219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333babe5-2c31-4748-9b11-fedb2cdc7be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333babe5-2c31-4748-9b11-fedb2cdc7be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d65399-fec7-4596-8604-18ecd177932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d65399-fec7-4596-8604-18ecd177932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67873209-a9c5-4fd3-9503-abadd2037644', 'volume_name': 'volume-67873209-a9c5-4fd3-9503-abadd2037644', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9ee3da-292e-417e-8a82-f9577ce17849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9ee3da-292e-417e-8a82-f9577ce17849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aedc38-9120-4d4e-a573-dbc9e1822f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Volume 67873209-a9c5-4fd3-9503-abadd2037644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67873209-a9c5-4fd3-9503-abadd2037644', 'volume_size': 1}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1131297721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67873209-a9c5-4fd3-9503-abadd2037644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454f76d0844840609f3e16a3d06f1ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:06Z,use_quota=True,user_id='eccacefdeee145a684ecfd6fa0293219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Creating volume 67873209-a9c5-4fd3-9503-abadd2037644 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:06 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:06 devstack sudo[94359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644 1073741824
Nov 05 11:58:06 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:06 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644 1073741824" returned: 0 in 0.705s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:06 devstack sudo[94367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644
Nov 05 11:58:06 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae26e4-59a0-4cab-add3-947e0487bfc5]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:07 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f
Nov 05 11:58:07 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:07 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aedc38-9120-4d4e-a573-dbc9e1822f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67873209-a9c5-4fd3-9503-abadd2037644', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f928ee64-b01e-4589-bb38-1ede012534e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Volume volume-67873209-a9c5-4fd3-9503-abadd2037644 (67873209-a9c5-4fd3-9503-abadd2037644): created successfully
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f928ee64-b01e-4589-bb38-1ede012534e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Flow 'volume_create_manager' (b6a6ccc9-a715-475a-9a99-ff9d1a361e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7f501213-b03e-4bec-b127-002851f1fce9 tempest-VolumesTransfersV355Test-964969685 None] Created volume successfully.
Nov 05 11:58:07 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" returned: 0 in 0.488s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:07 devstack sudo[94375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f
Nov 05 11:58:07 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:07 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-2f58f084-a24f-482d-b1b3-9d2d5915ad4f" released by "delete_volume" :: held 0.942s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['62b0a151-eafc-47be-b7cb-06308f25d98a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:08 devstack cinder-volume[87184]: WARNING cinder.db.api [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-710476638']
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['c53b4478-e51f-4168-800f-2bd129245fb1', 'f28b7a7f-af76-4e44-874d-5b7d6eabd024', 'd8452c59-7388-4e10-b1b2-6d79aab9a2d2', '32d24bb7-9e83-49a6-a005-34027f79c9e4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:08 devstack sudo[94384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:58:08 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Acquiring lock "cinder-67873209-a9c5-4fd3-9503-abadd2037644-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-67873209-a9c5-4fd3-9503-abadd2037644-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Acquiring lock "cinder-quobyte-67873209-a9c5-4fd3-9503-abadd2037644" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-quobyte-67873209-a9c5-4fd3-9503-abadd2037644" acquired by "delete_volume" :: waited 0.058s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:08 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.394s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57819b79-7ca0-4686-b6a7-eea047161491]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-73d272d8-9fa9-49d3-8d20-938ee9e2afe2 tempest-GroupSnapshotsTest-1538346861 None] Delete group completed successfully.
Nov 05 11:58:08 devstack sudo[94396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644
Nov 05 11:58:08 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:09 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644" returned: 0 in 0.546s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:09 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644
Nov 05 11:58:09 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:09 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-67873209-a9c5-4fd3-9503-abadd2037644" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-quobyte-67873209-a9c5-4fd3-9503-abadd2037644" released by "delete_volume" :: held 1.034s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Created reservations ['65d10066-2704-423d-82d6-b28230c4d623', '2f8e0aba-5b4e-400f-b4c8-acb2cd565ec9', '189814c7-e26e-4d96-84b0-b818da29441e', 'd19762db-2b81-4e27-a7e3-6e0f8572652a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:10 devstack sudo[94409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:58:10 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-38eb2dfa-ca01-427f-be64-ab8393ef0159 tempest-GroupSnapshotsTest-1538346861 None] Group tempest-GroupSnapshotsTest-Group-1270566963: creating
Nov 05 11:58:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-38eb2dfa-ca01-427f-be64-ab8393ef0159 tempest-GroupSnapshotsTest-1538346861 None] Group tempest-GroupSnapshotsTest-Group-1270566963: created successfully
Nov 05 11:58:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-38eb2dfa-ca01-427f-be64-ab8393ef0159 tempest-GroupSnapshotsTest-1538346861 None] Create group completed successfully.
Nov 05 11:58:10 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Deleted volume successfully.
Nov 05 11:58:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ce384f03-53bc-4e2d-8120-38b9c9b72dc9 tempest-VolumesTransfersV355Test-1137788171 None] Lock "cinder-67873209-a9c5-4fd3-9503-abadd2037644-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (1ef2b6c0-0018-40f6-a03a-3acfee4579b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068f8bc8-3033-42d0-a616-2896d175c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068f8bc8-3033-42d0-a616-2896d175c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037397638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afa5df5c-83bb-42ee-aa30-4ab56f8a0488,host='devstack@QuobyteHD#QuobyteHD',id=af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:13Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd6ad5d9-2e51-43a7-99d3-40ed048a2c82),volume_type_id=cd6ad5d9-2e51-43a7-99d3-40ed048a2c82)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d2e3c1-b2ff-407a-bdea-f1731250a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d2e3c1-b2ff-407a-bdea-f1731250a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebad792f-eba6-41d0-a14c-8b3fa3e1ef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebad792f-eba6-41d0-a14c-8b3fa3e1ef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6', 'volume_name': 'volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3ce55d-3d02-4047-a037-4ddcd439516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3ce55d-3d02-4047-a037-4ddcd439516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578fbad3-49c7-47d0-bd78-44157e8fdf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Volume af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6', 'volume_size': 1}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=afa5df5c-83bb-42ee-aa30-4ab56f8a0488,created_at=2026-11-05T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037397638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afa5df5c-83bb-42ee-aa30-4ab56f8a0488,host='devstack@QuobyteHD#QuobyteHD',id=af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:13Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd6ad5d9-2e51-43a7-99d3-40ed048a2c82),volume_type_id=cd6ad5d9-2e51-43a7-99d3-40ed048a2c82)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Creating volume af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:58:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:13 devstack sudo[94473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 1073741824
Nov 05 11:58:13 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:14 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 1073741824" returned: 0 in 1.051s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:14 devstack sudo[94480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6
Nov 05 11:58:14 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:14 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578fbad3-49c7-47d0-bd78-44157e8fdf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8d5a2b-97ef-4fd4-9818-b7ee645620e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Volume volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 (af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6): created successfully
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8d5a2b-97ef-4fd4-9818-b7ee645620e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (1ef2b6c0-0018-40f6-a03a-3acfee4579b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-caddaeca-b090-4f0d-af60-16476bf8eaec tempest-GroupSnapshotsTest-1538346861 None] Created volume successfully.
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (11b865a3-65a1-416a-a198-4221a5c2c439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e55b0c3-4194-4f70-9993-988dbeec99c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e55b0c3-4194-4f70-9993-988dbeec99c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697994219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afa5df5c-83bb-42ee-aa30-4ab56f8a0488,host='devstack@QuobyteHD#QuobyteHD',id=d7502b27-ea71-450f-8535-0267dc0cd97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:17Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd6ad5d9-2e51-43a7-99d3-40ed048a2c82),volume_type_id=cd6ad5d9-2e51-43a7-99d3-40ed048a2c82)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c279e4b2-ac9c-4467-9343-1c7ec12e643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c279e4b2-ac9c-4467-9343-1c7ec12e643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd62b050-72c6-4479-b486-449a0cfdbcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd62b050-72c6-4479-b486-449a0cfdbcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7502b27-ea71-450f-8535-0267dc0cd97e', 'volume_name': 'volume-d7502b27-ea71-450f-8535-0267dc0cd97e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c9aaf5-fb1d-46d9-83f7-7878ce45f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c9aaf5-fb1d-46d9-83f7-7878ce45f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76d6afc-167e-4513-80a9-b024d103b661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Volume d7502b27-ea71-450f-8535-0267dc0cd97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7502b27-ea71-450f-8535-0267dc0cd97e', 'volume_size': 1}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=afa5df5c-83bb-42ee-aa30-4ab56f8a0488,created_at=2026-11-05T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697994219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afa5df5c-83bb-42ee-aa30-4ab56f8a0488,host='devstack@QuobyteHD#QuobyteHD',id=d7502b27-ea71-450f-8535-0267dc0cd97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:17Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd6ad5d9-2e51-43a7-99d3-40ed048a2c82),volume_type_id=cd6ad5d9-2e51-43a7-99d3-40ed048a2c82)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Creating volume d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:17 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:58:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:17 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e 1073741824
Nov 05 11:58:17 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:18 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e 1073741824" returned: 0 in 1.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:18 devstack sudo[94546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e
Nov 05 11:58:18 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:19 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e" returned: 0 in 0.710s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76d6afc-167e-4513-80a9-b024d103b661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7502b27-ea71-450f-8535-0267dc0cd97e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964bea5a-b7dd-4f4e-831c-bd308ab107be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Volume volume-d7502b27-ea71-450f-8535-0267dc0cd97e (d7502b27-ea71-450f-8535-0267dc0cd97e): created successfully
Nov 05 11:58:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964bea5a-b7dd-4f4e-831c-bd308ab107be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (11b865a3-65a1-416a-a198-4221a5c2c439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-976befa9-1e7c-4cbb-bc4a-6b1325b88cf5 tempest-GroupSnapshotsTest-1538346861 None] Created volume successfully.
Nov 05 11:58:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3a1bd267-4957-43be-af18-68a798070cb9 tempest-GroupSnapshotsTest-1538346861 None] Update group completed successfully.
Nov 05 11:58:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1dac3ae8-3b10-4008-815d-7b9dfa5e9543 tempest-GroupSnapshotsTest-1538346861 None] Update group completed successfully.
Nov 05 11:58:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-34f03bb5-ffe1-40c1-ba40-6ba9eb4c41ef tempest-GroupSnapshotsTest-1538346861 None] Update group completed successfully.
Nov 05 11:58:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9d66c390-f33c-4f95-94e0-9b1c1cb80b9a tempest-GroupSnapshotsTest-1538346861 None] Update group completed successfully.
Nov 05 11:58:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] GroupSnapshot 934550c8-1438-411d-b083-f8a252c15e26: creating.
Nov 05 11:58:26 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=106,cinder:UPDATE=114,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:58:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Group snapshot 934550c8-1438-411d-b083-f8a252c15e26: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 11:58:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Creating offline snapshot 0793991e-ba09-4952-a4d4-c91bd8d9dd6b of volume af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:58:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a01965-eab7-4d58-a7bd-ac006d5f895c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:26 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6
Nov 05 11:58:26 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:27 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" returned: 0 in 0.522s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:27 devstack sudo[94623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b 1G
Nov 05 11:58:27 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:27 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b 1G" returned: 0 in 0.574s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:27 devstack sudo[94629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b
Nov 05 11:58:27 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:28 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b" returned: 0 in 0.335s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:28 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:58:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:28 devstack sudo[94634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b
Nov 05 11:58:28 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:28 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:28 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=101,cinder:UPDATE=109,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:58:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:28 devstack sudo[94639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.info
Nov 05 11:58:28 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:28 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.info" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:28 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:58:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:28 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.info
Nov 05 11:58:28 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:29 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.info" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Creating offline snapshot 5ece2374-6093-4950-b191-d97cde992d9e of volume d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99836cae-fcd9-4596-804c-47175ce1c6a2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:29 devstack sudo[94645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e
Nov 05 11:58:29 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:29 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e" returned: 0 in 0.470s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:29 devstack sudo[94650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e 1G
Nov 05 11:58:29 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:30 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e 1G" returned: 0 in 0.500s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7502b27-ea71-450f-8535-0267dc0cd97e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:30 devstack sudo[94656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7502b27-ea71-450f-8535-0267dc0cd97e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e
Nov 05 11:58:30 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:30 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7502b27-ea71-450f-8535-0267dc0cd97e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e" returned: 0 in 0.343s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:30 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:58:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:30 devstack sudo[94661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e
Nov 05 11:58:30 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:30 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:30 devstack sudo[94664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.info
Nov 05 11:58:30 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:31 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.info" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:31 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:58:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:31 devstack sudo[94667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.info
Nov 05 11:58:31 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:31 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.info" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-564499ae-707a-43f8-a7ec-ef2973baa1f5 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 934550c8-1438-411d-b083-f8a252c15e26: created successfully
Nov 05 11:58:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 934550c8-1438-411d-b083-f8a252c15e26: deleting
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 934550c8-1438-411d-b083-f8a252c15e26: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-0793991e-ba09-4952-a4d4-c91bd8d9dd6b" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-0793991e-ba09-4952-a4d4-c91bd8d9dd6b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Deleting offline snapshot 0793991e-ba09-4952-a4d4-c91bd8d9dd6b of volume af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] snapshot_file for this snap is: volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1a48f7-5c90-44bd-9102-54e23126e5c8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:32 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b
Nov 05 11:58:32 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:32 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b" returned: 0 in 0.517s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f12bf-a271-4a71-b8fc-e41d90cfa69b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:33 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6
Nov 05 11:58:33 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:33 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:33 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b
Nov 05 11:58:33 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:33 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:33 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b
Nov 05 11:58:33 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:34 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6.0793991e-ba09-4952-a4d4-c91bd8d9dd6b" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-0793991e-ba09-4952-a4d4-c91bd8d9dd6b" released by "_delete_snapshot" :: held 1.991s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" released by "delete_snapshot" :: held 2.024s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-d7502b27-ea71-450f-8535-0267dc0cd97e" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-d7502b27-ea71-450f-8535-0267dc0cd97e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-5ece2374-6093-4950-b191-d97cde992d9e" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-5ece2374-6093-4950-b191-d97cde992d9e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Deleting offline snapshot 5ece2374-6093-4950-b191-d97cde992d9e of volume d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] snapshot_file for this snap is: volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc1e2d-58f5-4186-b1bd-a07ae4d94d80]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:34 devstack sudo[94691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e
Nov 05 11:58:34 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:35 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e" returned: 0 in 0.777s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7502b27-ea71-450f-8535-0267dc0cd97e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[648f5c04-b7bf-434b-b400-0b0420ee6a95]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:35 devstack sudo[94713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e
Nov 05 11:58:35 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:35 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:35 devstack sudo[94719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e
Nov 05 11:58:35 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:36 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e" returned: 0 in 0.443s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:36 devstack sudo[94725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e
Nov 05 11:58:36 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:36 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e.5ece2374-6093-4950-b191-d97cde992d9e" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-5ece2374-6093-4950-b191-d97cde992d9e" released by "_delete_snapshot" :: held 2.129s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-d7502b27-ea71-450f-8535-0267dc0cd97e" released by "delete_snapshot" :: held 2.167s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:36 devstack cinder-volume[87184]: WARNING cinder.quota [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-175176052 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-175176052, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:36 devstack cinder-volume[87184]: WARNING cinder.quota [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-175176052 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-175176052, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['f6014edd-0f79-471c-b0b7-64af3a037ef7', 'e148227f-915d-4272-9c67-00bfd9030f08', '6db76682-eed5-4ccf-afa9-c186bb517cb0', '2e54f297-7a21-4abc-b904-e4baf7a6668a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['d034ba58-e065-4a78-aa6a-285c8bd1fb93', '3edc0f6b-6365-4f9e-9f7f-ee2b763c6cf9', '47245b84-4246-49cf-a0c2-72094c40ae8e', '2091e088-eb64-4f25-a5d7-cd2288b0f0e7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1101a6fb-ae0c-4fd7-a0b7-ac6fe69354e2 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 934550c8-1438-411d-b083-f8a252c15e26: deleted successfully
Nov 05 11:58:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a721da51-d40d-4e5b-9434-364944d239f0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:38 devstack sudo[94728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6
Nov 05 11:58:38 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" returned: 0 in 0.375s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:39 devstack sudo[94733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6
Nov 05 11:58:39 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-af4ac6e2-17e1-4a41-9fdb-38ec1b4064e6" released by "delete_volume" :: held 0.743s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-d7502b27-ea71-450f-8535-0267dc0cd97e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-d7502b27-ea71-450f-8535-0267dc0cd97e" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b20239-e5f8-4632-bb3f-af1795dc6725]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Flow 'volume_create_manager' (3c5efcf3-d005-4cd3-aac0-df56ba72667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4e64d0-a745-4fc9-b6ca-b29487909dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4e64d0-a745-4fc9-b6ca-b29487909dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-300960025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bff3ead-4e19-44ae-8f1c-c307af183493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5ff204b69743ed862bae52117520a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:39Z,use_quota=True,user_id='ca805acc8f1f490f8715b1ac6f614b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad92213-5018-4e2d-80ec-86d84c222f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad92213-5018-4e2d-80ec-86d84c222f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446e4dfa-2426-47dc-933c-5596f7a64681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:39 devstack sudo[94736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e
Nov 05 11:58:39 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446e4dfa-2426-47dc-933c-5596f7a64681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bff3ead-4e19-44ae-8f1c-c307af183493', 'volume_name': 'volume-3bff3ead-4e19-44ae-8f1c-c307af183493', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c244e120-1083-4739-b8a7-b1b1445588ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c244e120-1083-4739-b8a7-b1b1445588ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f56ec2-d787-4707-8a4b-6b5fcc7438f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Volume 3bff3ead-4e19-44ae-8f1c-c307af183493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bff3ead-4e19-44ae-8f1c-c307af183493', 'volume_size': 1}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-300960025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bff3ead-4e19-44ae-8f1c-c307af183493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5ff204b69743ed862bae52117520a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:39Z,use_quota=True,user_id='ca805acc8f1f490f8715b1ac6f614b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Creating volume 3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:39 devstack sudo[94738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 1073741824
Nov 05 11:58:39 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:39 devstack sudo[94746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e
Nov 05 11:58:39 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:40 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 1073741824" returned: 0 in 0.467s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:40 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d7502b27-ea71-450f-8535-0267dc0cd97e" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-d7502b27-ea71-450f-8535-0267dc0cd97e" released by "delete_volume" :: held 0.751s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:40 devstack sudo[94750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 11:58:40 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['78120a18-071b-4d0c-8187-de67db9b3fb3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:40 devstack cinder-volume[87184]: WARNING cinder.quota [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-175176052 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-175176052, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['41b28536-21d5-4c78-bf26-8362cac26b27', '5d863e97-b53c-4433-b5b0-18f98e183b1b', '90a0bfbb-8f1b-4fc6-9122-fe30f86f8918', 'cf8d9c0f-4bd3-4110-b9b3-94b9927d4613'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['a6b50220-d773-4927-8097-dddda177f272', 'bd5609f0-6e16-49d6-84d0-fb3699ce4287', 'daae1a4c-f824-4d49-9849-cf40feeb98e9', '1f8f324f-e5aa-4ed8-a3c0-a43c29f7d910'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:40 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f56ec2-d787-4707-8a4b-6b5fcc7438f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bff3ead-4e19-44ae-8f1c-c307af183493', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146c8218-e351-414c-a2c7-3730101d4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Volume volume-3bff3ead-4e19-44ae-8f1c-c307af183493 (3bff3ead-4e19-44ae-8f1c-c307af183493): created successfully
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146c8218-e351-414c-a2c7-3730101d4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Flow 'volume_create_manager' (3c5efcf3-d005-4cd3-aac0-df56ba72667c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-31e7c15d-767c-4f55-a6bf-bebc6f614f85 tempest-VolumesActionsTest-1324695527 None] Created volume successfully.
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:40 devstack sudo[94762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:58:40 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:40 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9aaf3887-35c6-4454-85df-4a75319f7f96 tempest-GroupSnapshotsTest-1538346861 None] Delete group completed successfully.
Nov 05 11:58:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4d8e6fb7-1d17-45c6-9675-a0dee2ce9655 tempest-GroupSnapshotsTest-1538346861 None] Group tempest-GroupSnapshotsTest-Group-1410823309: creating
Nov 05 11:58:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4d8e6fb7-1d17-45c6-9675-a0dee2ce9655 tempest-GroupSnapshotsTest-1538346861 None] Group tempest-GroupSnapshotsTest-Group-1410823309: created successfully
Nov 05 11:58:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4d8e6fb7-1d17-45c6-9675-a0dee2ce9655 tempest-GroupSnapshotsTest-1538346861 None] Create group completed successfully.
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (ab776856-2756-41d0-8398-f85aeabbe45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bb12f7-839d-43d5-bc48-5e0150828d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bb12f7-839d-43d5-bc48-5e0150828d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046029446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=926538d0-dbe8-40fe-8f4d-5c5f01b5cf47,host='devstack@QuobyteHD#QuobyteHD',id=eb85e78a-0bfe-4716-9ed8-7af238c76d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:43Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66bdb891-cbff-4480-a9a4-71b13556e23a),volume_type_id=66bdb891-cbff-4480-a9a4-71b13556e23a)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f85ad3-0993-4b20-b63b-2d5733a2ea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f85ad3-0993-4b20-b63b-2d5733a2ea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99805c30-164a-43f7-a9e3-42cc5a87ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99805c30-164a-43f7-a9e3-42cc5a87ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb85e78a-0bfe-4716-9ed8-7af238c76d7e', 'volume_name': 'volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dbc5e2-3188-4136-ad2b-d38e94714651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dbc5e2-3188-4136-ad2b-d38e94714651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb735d94-3c35-4f52-b1be-4c2950e2e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Volume eb85e78a-0bfe-4716-9ed8-7af238c76d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e', 'volume_size': 1}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=926538d0-dbe8-40fe-8f4d-5c5f01b5cf47,created_at=2026-11-05T10:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046029446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=926538d0-dbe8-40fe-8f4d-5c5f01b5cf47,host='devstack@QuobyteHD#QuobyteHD',id=eb85e78a-0bfe-4716-9ed8-7af238c76d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a6f0f6ca4045208a3960e47fed2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:43Z,use_quota=True,user_id='6e0d975c871340d18119cf650ff433f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66bdb891-cbff-4480-a9a4-71b13556e23a),volume_type_id=66bdb891-cbff-4480-a9a4-71b13556e23a)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Creating volume eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:43 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:58:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:43 devstack sudo[94829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e 1073741824
Nov 05 11:58:43 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:44 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e 1073741824" returned: 0 in 0.688s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:44 devstack sudo[94839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e
Nov 05 11:58:44 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:44 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb735d94-3c35-4f52-b1be-4c2950e2e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a166f2-bb4e-40ac-b02b-1908ddb2d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Volume volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e (eb85e78a-0bfe-4716-9ed8-7af238c76d7e): created successfully
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a166f2-bb4e-40ac-b02b-1908ddb2d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Flow 'volume_create_manager' (ab776856-2756-41d0-8398-f85aeabbe45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-71510eed-b853-4848-92e5-6c3476f57dc7 tempest-GroupSnapshotsTest-1538346861 None] Created volume successfully.
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:45 devstack sudo[94853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:58:45 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:45 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:58:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Flow 'volume_create_manager' (2707b904-56d1-4210-b517-405644192814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0d2ec9-2581-4773-9017-f6ae973df835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0d2ec9-2581-4773-9017-f6ae973df835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-800442613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba1400f-52cc-4f86-89d0-6895bb45462c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146fcf9491514a4ebd96794d37b53588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:46Z,use_quota=True,user_id='bbf6ef4b1e7a49b2a0f132f25a71c64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914a08ed-5cef-4c5b-b64b-ef167b413518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914a08ed-5cef-4c5b-b64b-ef167b413518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501229a9-4541-42fa-8470-1c511c43cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501229a9-4541-42fa-8470-1c511c43cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba1400f-52cc-4f86-89d0-6895bb45462c', 'volume_name': 'volume-2ba1400f-52cc-4f86-89d0-6895bb45462c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584fdb21-7bf4-455a-bed6-e101705ce8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584fdb21-7bf4-455a-bed6-e101705ce8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67684e73-06a7-41a5-99ef-fd66a5ca6972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:46 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Volume 2ba1400f-52cc-4f86-89d0-6895bb45462c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba1400f-52cc-4f86-89d0-6895bb45462c', 'volume_size': 1}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-800442613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba1400f-52cc-4f86-89d0-6895bb45462c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146fcf9491514a4ebd96794d37b53588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:46Z,use_quota=True,user_id='bbf6ef4b1e7a49b2a0f132f25a71c64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Creating volume 2ba1400f-52cc-4f86-89d0-6895bb45462c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:46 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:46 devstack sudo[94867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c 1073741824
Nov 05 11:58:46 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] GroupSnapshot 1e2b06e3-09c5-4498-8fdc-4f1a6b6764b1: creating.
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Group snapshot 1e2b06e3-09c5-4498-8fdc-4f1a6b6764b1: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:46 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c 1073741824" returned: 0 in 0.527s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:46 devstack sudo[94873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c
Nov 05 11:58:46 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:47 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.556s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67684e73-06a7-41a5-99ef-fd66a5ca6972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba1400f-52cc-4f86-89d0-6895bb45462c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b715cdb2-d527-4a96-b077-a17847272aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Creating offline snapshot 623d3fc3-dd3e-42e2-9112-23bbef005321 of volume eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:58:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Volume volume-2ba1400f-52cc-4f86-89d0-6895bb45462c (2ba1400f-52cc-4f86-89d0-6895bb45462c): created successfully
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b715cdb2-d527-4a96-b077-a17847272aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Flow 'volume_create_manager' (2707b904-56d1-4210-b517-405644192814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc8fa57-3135-4dba-8b4b-c8e39610eaa8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bafd3050-939a-446d-819d-5ac9eec5e777 tempest-AttachVolumeTestJSON-921537592 None] Created volume successfully.
Nov 05 11:58:47 devstack sudo[94876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e
Nov 05 11:58:47 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:47 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" returned: 0 in 0.493s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:47 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 1G
Nov 05 11:58:47 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 1G" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:48 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:48 devstack sudo[94891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321
Nov 05 11:58:48 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:48 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321" returned: 0 in 0.614s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:48 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:58:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:48 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321
Nov 05 11:58:48 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:49 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321" returned: 0 in 0.504s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:49 devstack sudo[94972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.info
Nov 05 11:58:49 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-83b65a26-8c60-4401-9fd9-e46a9b77ec20 req-94ef6d1f-5380-49ef-8b1a-39421ec8023f tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:50 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.info" returned: 0 in 0.531s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:50 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:50 devstack sudo[94980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.info
Nov 05 11:58:50 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:50 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.info" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.326s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-83b65a26-8c60-4401-9fd9-e46a9b77ec20 req-94ef6d1f-5380-49ef-8b1a-39421ec8023f tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.477s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-83b65a26-8c60-4401-9fd9-e46a9b77ec20 req-94ef6d1f-5380-49ef-8b1a-39421ec8023f tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-83b65a26-8c60-4401-9fd9-e46a9b77ec20 req-94ef6d1f-5380-49ef-8b1a-39421ec8023f tempest-AttachVolumeTestJSON-921537592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-2ba1400f-52cc-4f86-89d0-6895bb45462c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46407182-67d8-4497-8df7-2185d95b7da2', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:58:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-03dc46fe-32d2-4a23-823e-7d02dbd70588 tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 1e2b06e3-09c5-4498-8fdc-4f1a6b6764b1: created successfully
Nov 05 11:58:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e1e7c657-d415-4033-b67d-37d6f598c05c req-5fec3099-4102-49a3-9031-0531561f12d0 tempest-AttachVolumeNegativeTest-83723807 None] Terminate volume connection completed successfully.
Nov 05 11:58:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e1e7c657-d415-4033-b67d-37d6f598c05c req-5fec3099-4102-49a3-9031-0531561f12d0 tempest-AttachVolumeNegativeTest-83723807 None] Deleting attachment 66d8abb5-0af0-444c-a6b8-dc1dfcb6918b. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:58:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-83b65a26-8c60-4401-9fd9-e46a9b77ec20 req-94ef6d1f-5380-49ef-8b1a-39421ec8023f tempest-AttachVolumeTestJSON-921537592 None] attachment_update completed successfully.
Nov 05 11:58:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 1e2b06e3-09c5-4498-8fdc-4f1a6b6764b1: deleting
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 1e2b06e3-09c5-4498-8fdc-4f1a6b6764b1: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7514207d-68a5-4c16-9a31-f416ae3f1ac8 tempest-VolumesActionsTest-1324695527 None] Acquiring lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493" by "attach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7514207d-68a5-4c16-9a31-f416ae3f1ac8 tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493" acquired by "attach_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-623d3fc3-dd3e-42e2-9112-23bbef005321" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-623d3fc3-dd3e-42e2-9112-23bbef005321" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Deleting offline snapshot 623d3fc3-dd3e-42e2-9112-23bbef005321 of volume eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] snapshot_file for this snap is: volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f62f47-864d-44d7-9850-95bcb5ac9b36]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7514207d-68a5-4c16-9a31-f416ae3f1ac8 tempest-VolumesActionsTest-1324695527 None] Attaching volume 3bff3ead-4e19-44ae-8f1c-c307af183493 to instance a540a4b6-550f-4135-89d6-3bd3f735f58b at mountpoint /dev/vdb on host None.
Nov 05 11:58:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7514207d-68a5-4c16-9a31-f416ae3f1ac8 tempest-VolumesActionsTest-1324695527 None] Attach volume completed successfully.
Nov 05 11:58:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7514207d-68a5-4c16-9a31-f416ae3f1ac8 tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493" released by "attach_volume" :: held 0.364s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:51 devstack sudo[95404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321
Nov 05 11:58:51 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-26c2809f-a25b-4d3b-aac9-f5d783bf1350 tempest-VolumesActionsTest-1324695527 None] Acquiring lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-26c2809f-a25b-4d3b-aac9-f5d783bf1350 tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-26c2809f-a25b-4d3b-aac9-f5d783bf1350 tempest-VolumesActionsTest-1324695527 None] Detaching volume 3bff3ead-4e19-44ae-8f1c-c307af183493 from instance a540a4b6-550f-4135-89d6-3bd3f735f58b.
Nov 05 11:58:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-26c2809f-a25b-4d3b-aac9-f5d783bf1350 tempest-VolumesActionsTest-1324695527 None] Detach volume completed successfully.
Nov 05 11:58:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-26c2809f-a25b-4d3b-aac9-f5d783bf1350 tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-detach_volume" released by "detach_volume" :: held 0.313s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:52 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321" returned: 0 in 1.187s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ed9438-1366-4e02-8404-abd908d53f80]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:53 devstack sudo[95427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e
Nov 05 11:58:53 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:53 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" returned: 0 in 0.602s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:53 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321
Nov 05 11:58:53 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:54 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321" returned: 0 in 0.710s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:54 devstack sudo[95482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321
Nov 05 11:58:54 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:54 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e.623d3fc3-dd3e-42e2-9112-23bbef005321" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-623d3fc3-dd3e-42e2-9112-23bbef005321" released by "_delete_snapshot" :: held 3.127s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" released by "delete_snapshot" :: held 3.173s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:54 devstack cinder-volume[87184]: WARNING cinder.quota [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1256133706 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1256133706, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:54 devstack cinder-volume[87184]: WARNING cinder.quota [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1256133706 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1256133706, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:54 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['07268e1a-3d00-4030-a5ea-d51af4c466af', '13aa6e85-fb64-441d-aa7d-ef9a987e5665', 'e277659d-1432-44d2-9b77-068b3884c8f0', '6ab8f512-4d7d-4ff3-ba71-e4655aa7ea71'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-96b49423-b121-4073-80a3-219702efcf6c tempest-GroupSnapshotsTest-1538346861 None] group_snapshot 1e2b06e3-09c5-4498-8fdc-4f1a6b6764b1: deleted successfully
Nov 05 11:58:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "cinder-quobyte-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64b9c0b-29a9-4da4-9b4e-29600f50108f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:55 devstack sudo[95511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e
Nov 05 11:58:55 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:56 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" returned: 0 in 0.609s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:56 devstack sudo[95519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e
Nov 05 11:58:56 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:56 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Lock "cinder-quobyte-eb85e78a-0bfe-4716-9ed8-7af238c76d7e" released by "delete_volume" :: held 1.170s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['87c5c32c-45f0-427b-91ea-fe0e1fa6eab6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:57 devstack cinder-volume[87184]: WARNING cinder.quota [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1256133706 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1256133706, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Created reservations ['5733e4fd-f711-432c-aef5-8b7cf6ba823a', '79f7b79c-5d88-4387-8d65-a4fef017dcb1', '562ce8e7-0fe8-44d4-8a0d-2b5a5089f71f', '172892af-3a28-43de-8f10-ed3d21c9a51c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:57 devstack sudo[95522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:58:57 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:57 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:57 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-717e47af-50f3-4d36-a735-5d31fbceabe5 tempest-GroupSnapshotsTest-1538346861 None] Delete group completed successfully.
Nov 05 11:59:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:INSERT=19,cinder:UPDATE=68,cinder:SELECT=75,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=68,cinder:SELECT=71,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-951e27db-8bbc-4797-8b48-a9bd39af0dff tempest-VolumesActionsTest-1324695527 None] Acquiring lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493" by "attach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-951e27db-8bbc-4797-8b48-a9bd39af0dff tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493" acquired by "attach_volume" :: waited 0.056s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-951e27db-8bbc-4797-8b48-a9bd39af0dff tempest-VolumesActionsTest-1324695527 None] Attaching volume 3bff3ead-4e19-44ae-8f1c-c307af183493 to instance fdfac743-3388-4573-83df-97997a561e68 at mountpoint /dev/vdb on host None.
Nov 05 11:59:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-951e27db-8bbc-4797-8b48-a9bd39af0dff tempest-VolumesActionsTest-1324695527 None] Attach volume completed successfully.
Nov 05 11:59:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-951e27db-8bbc-4797-8b48-a9bd39af0dff tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493" released by "attach_volume" :: held 0.321s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f01bbf20-671f-4f51-84bb-ff1936e26388 tempest-VolumesActionsTest-1324695527 None] Acquiring lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f01bbf20-671f-4f51-84bb-ff1936e26388 tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f01bbf20-671f-4f51-84bb-ff1936e26388 tempest-VolumesActionsTest-1324695527 None] Detaching volume 3bff3ead-4e19-44ae-8f1c-c307af183493 from instance fdfac743-3388-4573-83df-97997a561e68.
Nov 05 11:59:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f01bbf20-671f-4f51-84bb-ff1936e26388 tempest-VolumesActionsTest-1324695527 None] Detach volume completed successfully.
Nov 05 11:59:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f01bbf20-671f-4f51-84bb-ff1936e26388 tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20ccdf1-15d7-4685-9840-ba4c23cbe97a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:18 devstack sudo[96305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 11:59:18 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:19 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.724s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe2db2-a9cd-4c96-93d0-1add3c5dd61b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:19 devstack sudo[96311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 11:59:19 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:19 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.545s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.c19f38ed-299c-4315-8ad3-37ab9f828a91ki5z5slw.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:19 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.c19f38ed-299c-4315-8ad3-37ab9f828a91ki5z5slw.img
Nov 05 11:59:19 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:21 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:INSERT=1,cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Flow 'volume_create_manager' (8c92a72d-f982-4ff1-b4ab-4cbc17dc43d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ea2bd2-318c-46e5-b839-9ba3466b468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ea2bd2-318c-46e5-b839-9ba3466b468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1108700698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee77289-eb8f-44c8-9d40-bb25fe6cef03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4da96366944d769e2249d79aa8bc33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:28Z,use_quota=True,user_id='21eba3322813403eb0bee71515a38c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4fa1e1-0b6f-4a73-b588-68cdb016c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4fa1e1-0b6f-4a73-b588-68cdb016c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b2e000-8d58-4ec6-a022-cb70d0a867a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b2e000-8d58-4ec6-a022-cb70d0a867a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee77289-eb8f-44c8-9d40-bb25fe6cef03', 'volume_name': 'volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f0d624-8d25-4dd9-8f79-237b1916535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f0d624-8d25-4dd9-8f79-237b1916535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f10d68-1f94-4519-869f-c83f78910e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Volume dee77289-eb8f-44c8-9d40-bb25fe6cef03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03', 'volume_size': 1}
Nov 05 11:59:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:29 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.c19f38ed-299c-4315-8ad3-37ab9f828a91ki5z5slw.img" returned: 0 in 9.222s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75e476a-97ad-4267-99e4-a52653df2908]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:29 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 11:59:29 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:29 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.641s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:29 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493, size 1024.00 MB, duration 9.22 sec, destination /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.c19f38ed-299c-4315-8ad3-37ab9f828a91ki5z5slw.img {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:59:29 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Converted 1024.00 MB image at 111.02 MB/s
Nov 05 11:59:29 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] c19f38ed-299c-4315-8ad3-37ab9f828a91 was raw, no need to convert to raw {{(pid=87184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 11:59:39 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:39 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-f43b24fc-74ea-45cf-b39d-767d6528fe86 req-fc80947d-b4d2-4086-926a-deb9c5176bd4 tempest-AttachVolumeTestJSON-921537592 None] Terminate volume connection completed successfully.
Nov 05 11:59:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-f43b24fc-74ea-45cf-b39d-767d6528fe86 req-fc80947d-b4d2-4086-926a-deb9c5176bd4 tempest-AttachVolumeTestJSON-921537592 None] Deleting attachment 46407182-67d8-4497-8df7-2185d95b7da2. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Flow 'volume_create_manager' (4f07ae1a-2e65-4381-8074-16bc4a587a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8895c532-862a-4150-8334-a820f11a35cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8895c532-862a-4150-8334-a820f11a35cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1672759515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f513cdc-39db-4d02-ad15-1a9d1166f3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c42166bdec64372abf3f80b866a48c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:42Z,use_quota=True,user_id='1833afd056484ae69e27836f808b4446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c2c67b-69e8-49ec-b237-ec81073d7406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c2c67b-69e8-49ec-b237-ec81073d7406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e273a9-1a4b-4483-8b17-263a5770e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e273a9-1a4b-4483-8b17-263a5770e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f513cdc-39db-4d02-ad15-1a9d1166f3b2', 'volume_name': 'volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be22907-bf65-47f4-be5b-edfde1ffd11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be22907-bf65-47f4-be5b-edfde1ffd11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8e7e16-0c34-447a-b894-14ce11e70aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Volume 7f513cdc-39db-4d02-ad15-1a9d1166f3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2', 'volume_size': 1}
Nov 05 11:59:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:45 devstack sudo[96424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 11:59:45 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:45 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.375s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:59:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:59:51 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.995s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Uploaded volume to glance image-id: c19f38ed-299c-4315-8ad3-37ab9f828a91. {{(pid=87184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.699s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1108700698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee77289-eb8f-44c8-9d40-bb25fe6cef03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4da96366944d769e2249d79aa8bc33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:28Z,use_quota=True,user_id='21eba3322813403eb0bee71515a38c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Creating volume dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:59:52 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:59:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:52 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 1073741824
Nov 05 11:59:52 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3c61bd93-beae-4242-bf3e-895a3dca752b tempest-VolumesActionsTest-1324695527 None] Copy volume to image completed successfully.
Nov 05 11:59:53 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 1073741824" returned: 0 in 0.467s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:53 devstack sudo[96511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03
Nov 05 11:59:53 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:53 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.531s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1672759515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f513cdc-39db-4d02-ad15-1a9d1166f3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c42166bdec64372abf3f80b866a48c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:42Z,use_quota=True,user_id='1833afd056484ae69e27836f808b4446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Creating volume 7f513cdc-39db-4d02-ad15-1a9d1166f3b2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:59:53 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f10d68-1f94-4519-869f-c83f78910e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:53 devstack sudo[96515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2 1073741824
Nov 05 11:59:53 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f688f691-b4d3-496a-b2ae-1d2316ab13a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Volume volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 (dee77289-eb8f-44c8-9d40-bb25fe6cef03): created successfully
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f688f691-b4d3-496a-b2ae-1d2316ab13a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Flow 'volume_create_manager' (8c92a72d-f982-4ff1-b4ab-4cbc17dc43d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-286ef7f1-c2c0-4775-9b85-74653c3f7b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Created volume successfully.
Nov 05 11:59:54 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2 1073741824" returned: 0 in 0.773s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:54 devstack sudo[96520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2
Nov 05 11:59:54 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:54 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.358s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Creating offline snapshot bd99afba-9978-4e57-b0c3-a93fe250e348 of volume dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8e7e16-0c34-447a-b894-14ce11e70aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380e04a9-dd5a-4291-88b1-8fc9bdee568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf36d37c-2393-4713-94d8-7dd04b6dc34a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Volume volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2 (7f513cdc-39db-4d02-ad15-1a9d1166f3b2): created successfully
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380e04a9-dd5a-4291-88b1-8fc9bdee568f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Flow 'volume_create_manager' (4f07ae1a-2e65-4381-8074-16bc4a587a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-eb34382d-d821-4015-9803-20bb1215913f tempest-AttachVolumeNegativeTest-83723807 None] Created volume successfully.
Nov 05 11:59:54 devstack sudo[96523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03
Nov 05 11:59:54 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:55 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03" returned: 0 in 0.557s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:55 devstack sudo[96566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 1G
Nov 05 11:59:55 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:55 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 1G" returned: 0 in 0.623s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:55 devstack sudo[96574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348
Nov 05 11:59:55 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-0954bbd1-448f-4209-93d2-35e09f256efa req-6a9504b4-0700-4d6c-ae7e-4c1da9a0afdb tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:56 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 is being set with open permissions: ugo+rw
Nov 05 11:59:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:56 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348
Nov 05 11:59:56 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:56 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:56 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.info
Nov 05 11:59:56 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:56 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.info" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.info is being set with open permissions: ugo+rw
Nov 05 11:59:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:56 devstack sudo[96594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.info
Nov 05 11:59:56 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:57 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.info" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.958s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f750367-dc18-4287-8473-9343668c80ff]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cc5ee1ad-f16a-4aa6-b7e9-f9ec47bf536b tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Create snapshot completed successfully
Nov 05 11:59:57 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 11:59:57 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:57 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.473s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc018b4-f622-4fb4-8991-e86ed9b8fea3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:57 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 11:59:57 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "cinder-bd99afba-9978-4e57-b0c3-a93fe250e348-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-bd99afba-9978-4e57-b0c3-a93fe250e348-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "cinder-quobyte-dee77289-eb8f-44c8-9d40-bb25fe6cef03" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-quobyte-dee77289-eb8f-44c8-9d40-bb25fe6cef03" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "cinder-quobyte-bd99afba-9978-4e57-b0c3-a93fe250e348" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-quobyte-bd99afba-9978-4e57-b0c3-a93fe250e348" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:58 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Deleting offline snapshot bd99afba-9978-4e57-b0c3-a93fe250e348 of volume dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] snapshot_file for this snap is: volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.572s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[affbc137-7f14-49eb-b8ce-e77da062da53]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:58 devstack sudo[96608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img
Nov 05 11:59:58 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:58 devstack sudo[96609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348
Nov 05 11:59:58 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:58 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348" returned: 0 in 0.697s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:59:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e83eec8-7c49-40fd-9f89-a83c1eb0be6f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:59 devstack sudo[96625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03
Nov 05 11:59:59 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:59 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03" returned: 0 in 0.977s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:00 devstack sudo[96630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348
Nov 05 12:00:00 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:01 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348" returned: 0 in 1.048s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:01 devstack sudo[96637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348
Nov 05 12:00:01 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:01 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03.bd99afba-9978-4e57-b0c3-a93fe250e348" returned: 0 in 0.515s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-quobyte-bd99afba-9978-4e57-b0c3-a93fe250e348" released by "_delete_snapshot" :: held 3.517s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-quobyte-dee77289-eb8f-44c8-9d40-bb25fe6cef03" released by "delete_snapshot" :: held 3.566s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:01 devstack cinder-volume[87184]: WARNING cinder.quota [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:00:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Created reservations ['7deafc9d-a832-4895-86df-f78be7de408f', '4f56aa4f-9266-4b06-877b-e34f6c3f1dd3', 'f8779a96-fe20-4a53-9dfb-7e6aaa37a037', '430e0381-2043-4952-a0a0-c0ef7045a89c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Delete snapshot completed successfully.
Nov 05 12:00:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e005f49-2710-4a67-97cd-152b6b1d3d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-bd99afba-9978-4e57-b0c3-a93fe250e348-delete_snapshot" released by "delete_snapshot" :: held 3.859s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "cinder-dee77289-eb8f-44c8-9d40-bb25fe6cef03-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-dee77289-eb8f-44c8-9d40-bb25fe6cef03-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "cinder-quobyte-dee77289-eb8f-44c8-9d40-bb25fe6cef03" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-quobyte-dee77289-eb8f-44c8-9d40-bb25fe6cef03" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b63b72a-ddf0-4c90-ad89-8979a96c3206]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:03 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03
Nov 05 12:00:03 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:04 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03" returned: 0 in 0.924s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:04 devstack sudo[96649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03
Nov 05 12:00:04 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:05 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dee77289-eb8f-44c8-9d40-bb25fe6cef03" returned: 0 in 0.556s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-quobyte-dee77289-eb8f-44c8-9d40-bb25fe6cef03" released by "delete_volume" :: held 1.694s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Created reservations ['4c0af460-cd4e-497e-a90a-45e8c8de491e', 'e1b487fe-9c70-42d0-b249-1650a0fdc541', 'fe320652-c0cd-438f-aee1-6111664968cd', '1c03866d-2ca9-439b-88e2-e11c656f07e2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:05 devstack sudo[96652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:00:05 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:05 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Deleted volume successfully.
Nov 05 12:00:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3b5ae47c-c40f-4557-a96f-ac6890e89445 tempest-VolumeSnapshotQuotasNegativeTestJSON-1625399332 None] Lock "cinder-dee77289-eb8f-44c8-9d40-bb25fe6cef03-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:06 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img" returned: 0 in 8.716s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e3eedb-2d1e-48b8-91cb-392710af2cc1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:07 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 12:00:07 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:07 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.653s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:07 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:00:07 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Converted 1024.00 MB image at 117.46 MB/s
Nov 05 12:00:07 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] d060b55d-dabb-4f8c-a103-23e8a4eb8927 was raw, converting to qcow2 {{(pid=87184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 05 12:00:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b05a9f1-ceaa-49c9-8eed-3e83f564e0a0]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:07 devstack sudo[96661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img
Nov 05 12:00:07 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:08 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img" returned: 0 in 0.422s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:08 devstack sudo[96665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img
Nov 05 12:00:08 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:08 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img" returned: 1 in 0.439s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img /opt/stack/data/cinder/conversion/vol_upload_21hlffll {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:08 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img /opt/stack/data/cinder/conversion/vol_upload_21hlffll
Nov 05 12:00:08 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:08 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img /opt/stack/data/cinder/conversion/vol_upload_21hlffll" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Image conversion details: src /opt/stack/data/cinder/conversion/3bff3ead-4e19-44ae-8f1c-c307af183493.temp_image.d060b55d-dabb-4f8c-a103-23e8a4eb89279_wsfyd6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_21hlffll {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:00:08 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6294d3-e8f7-4d69-a8d9-4d1a69dfd08f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_21hlffll {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:08 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_21hlffll
Nov 05 12:00:08 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:09 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_21hlffll" returned: 0 in 0.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.289s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Uploaded volume to glance image-id: d060b55d-dabb-4f8c-a103-23e8a4eb8927. {{(pid=87184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 12:00:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-0954bbd1-448f-4209-93d2-35e09f256efa req-6a9504b4-0700-4d6c-ae7e-4c1da9a0afdb tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.217s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-0954bbd1-448f-4209-93d2-35e09f256efa req-6a9504b4-0700-4d6c-ae7e-4c1da9a0afdb tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5cddc47c-0180-4cbc-9cc1-9a83bf0b2e33 tempest-VolumesActionsTest-1324695527 None] Copy volume to image completed successfully.
Nov 05 12:00:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-0954bbd1-448f-4209-93d2-35e09f256efa req-6a9504b4-0700-4d6c-ae7e-4c1da9a0afdb tempest-AttachVolumeNegativeTest-83723807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9200f48-076d-44b9-abcf-deee7126064d', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:00:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-0954bbd1-448f-4209-93d2-35e09f256efa req-6a9504b4-0700-4d6c-ae7e-4c1da9a0afdb tempest-AttachVolumeNegativeTest-83723807 None] attachment_update completed successfully.
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Acquiring lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Acquiring lock "cinder-quobyte-3bff3ead-4e19-44ae-8f1c-c307af183493" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Lock "cinder-quobyte-3bff3ead-4e19-44ae-8f1c-c307af183493" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b93cc-0a32-4f20-ad9b-193f0c00eb4d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:13 devstack sudo[97097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 12:00:13 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:13 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:13 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493
Nov 05 12:00:13 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:13 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bff3ead-4e19-44ae-8f1c-c307af183493" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Lock "cinder-quobyte-3bff3ead-4e19-44ae-8f1c-c307af183493" released by "delete_volume" :: held 0.851s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Created reservations ['091083f9-92bb-446e-a31e-24a87b44d7f2', '99cb8395-d677-4148-a07b-a31bc439f4f1', '630e2740-376a-48e8-b39c-8e974b4b311e', 'da734594-d3b5-44e3-b3d3-4f8f7423f862'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:14 devstack sudo[97133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:00:14 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-0ada375e-804c-4509-a477-5408e590300a req-47ad40ef-18da-47e3-a61b-bc6f6e35530b tempest-AttachVolumeNegativeTest-83723807 None] Terminate volume connection completed successfully.
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-0ada375e-804c-4509-a477-5408e590300a req-47ad40ef-18da-47e3-a61b-bc6f6e35530b tempest-AttachVolumeNegativeTest-83723807 None] Deleting attachment e9200f48-076d-44b9-abcf-deee7126064d. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:00:14 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Deleted volume successfully.
Nov 05 12:00:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c320223-759a-4a1e-8fa1-fc86de1347ec tempest-VolumesActionsTest-1324695527 None] Lock "cinder-3bff3ead-4e19-44ae-8f1c-c307af183493-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:24 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=35,cinder:INSERT=9,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:00:24 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=31,cinder:UPDATE=41,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Flow 'volume_create_manager' (4c0c4431-f64b-4a21-96d6-0555ac5c68fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1655a960-a7c7-441a-b849-3464b8a0cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1655a960-a7c7-441a-b849-3464b8a0cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2004881988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885723db-d867-4524-bcab-88796f6373e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ad6a950c3f4172abc4af027df1c507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:27Z,use_quota=True,user_id='13b3ecee574a4bfd8c9612162c5e2abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba6d093-a1f2-4545-8a69-0e784e2eadb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba6d093-a1f2-4545-8a69-0e784e2eadb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa68091-d4ba-4cfb-96d6-5466bcae577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa68091-d4ba-4cfb-96d6-5466bcae577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885723db-d867-4524-bcab-88796f6373e1', 'volume_name': 'volume-885723db-d867-4524-bcab-88796f6373e1', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4eba214-aef9-4662-83eb-e0e7cccfdcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4eba214-aef9-4662-83eb-e0e7cccfdcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d154efd-d457-4591-aec5-5ded3b52cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Volume 885723db-d867-4524-bcab-88796f6373e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885723db-d867-4524-bcab-88796f6373e1', 'volume_size': 2}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2004881988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885723db-d867-4524-bcab-88796f6373e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ad6a950c3f4172abc4af027df1c507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:27Z,use_quota=True,user_id='13b3ecee574a4bfd8c9612162c5e2abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Creating volume 885723db-d867-4524-bcab-88796f6373e1 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:27 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:00:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1 2147483648 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:27 devstack sudo[97192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1 2147483648
Nov 05 12:00:27 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:28 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1 2147483648" returned: 0 in 0.765s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:28 devstack sudo[97198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1
Nov 05 12:00:28 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:28 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1" returned: 0 in 0.422s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Flow 'volume_create_manager' (f0a319f2-eed5-4d36-8156-c024eb098a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e0fd69-7234-4225-81c8-85553ab5ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d154efd-d457-4591-aec5-5ded3b52cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885723db-d867-4524-bcab-88796f6373e1', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dabe582-b349-4b00-9b8d-057eae6988cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e0fd69-7234-4225-81c8-85553ab5ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1842748527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe229219-c34f-4b9b-8a0b-783a16d6122d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c12740c222342e3908f10f4c9333b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:29Z,use_quota=True,user_id='b3b0df2611f14321a3c2d7a10a2505ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2ada27-36d9-444f-833b-f3f5d7f752e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2ada27-36d9-444f-833b-f3f5d7f752e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c58296-c088-43e1-93c5-516f5967e507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c58296-c088-43e1-93c5-516f5967e507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe229219-c34f-4b9b-8a0b-783a16d6122d', 'volume_name': 'volume-fe229219-c34f-4b9b-8a0b-783a16d6122d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9399a51-dae7-4836-82dc-8ea64a77fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9399a51-dae7-4836-82dc-8ea64a77fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0db0f7d-ac30-49ea-b0e6-cd9f85b57f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Volume fe229219-c34f-4b9b-8a0b-783a16d6122d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe229219-c34f-4b9b-8a0b-783a16d6122d', 'volume_size': 1}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1842748527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe229219-c34f-4b9b-8a0b-783a16d6122d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c12740c222342e3908f10f4c9333b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:29Z,use_quota=True,user_id='b3b0df2611f14321a3c2d7a10a2505ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Creating volume fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:28 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Volume volume-885723db-d867-4524-bcab-88796f6373e1 (885723db-d867-4524-bcab-88796f6373e1): created successfully
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dabe582-b349-4b00-9b8d-057eae6988cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Flow 'volume_create_manager' (4c0c4431-f64b-4a21-96d6-0555ac5c68fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:28 devstack sudo[97203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d 1073741824
Nov 05 12:00:28 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f1cc40d8-1acf-41e6-9934-2d1aec003d7f tempest-VolumesCloneNegativeTest-898565462 None] Created volume successfully.
Nov 05 12:00:29 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d 1073741824" returned: 0 in 0.681s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:29 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d
Nov 05 12:00:29 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Acquiring lock "cinder-885723db-d867-4524-bcab-88796f6373e1-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Lock "cinder-885723db-d867-4524-bcab-88796f6373e1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Acquiring lock "cinder-quobyte-885723db-d867-4524-bcab-88796f6373e1" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Lock "cinder-quobyte-885723db-d867-4524-bcab-88796f6373e1" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a08a7-b432-46cb-9024-300069502f64]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:30 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d" returned: 0 in 0.543s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:30 devstack sudo[97226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1
Nov 05 12:00:30 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0db0f7d-ac30-49ea-b0e6-cd9f85b57f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe229219-c34f-4b9b-8a0b-783a16d6122d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca34b5c-c88a-4b42-8ac3-03acb492a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Volume volume-fe229219-c34f-4b9b-8a0b-783a16d6122d (fe229219-c34f-4b9b-8a0b-783a16d6122d): created successfully
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca34b5c-c88a-4b42-8ac3-03acb492a602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Flow 'volume_create_manager' (f0a319f2-eed5-4d36-8156-c024eb098a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a8dbc253-314c-429a-b57f-323b6d01f80f tempest-SnapshotMetadataTestJSON-1173964799 None] Created volume successfully.
Nov 05 12:00:30 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1" returned: 0 in 0.721s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:30 devstack sudo[97235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1
Nov 05 12:00:30 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:31 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-885723db-d867-4524-bcab-88796f6373e1" returned: 0 in 0.504s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Lock "cinder-quobyte-885723db-d867-4524-bcab-88796f6373e1" released by "delete_volume" :: held 1.332s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Creating offline snapshot 52775f6d-b474-4b6a-8870-46712d5a42b5 of volume fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a7235a-d0c2-43a2-8368-c59fa78bab95]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Created reservations ['90a61781-6c9f-444f-8256-ebb6fc2cc694', '8034a10c-670c-4a63-9268-e4d6da064421', '2fc31fa0-6367-48f4-b969-aca4182d3e8c', '545428fe-e524-4d53-8293-320f25947e3e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:31 devstack sudo[97238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d
Nov 05 12:00:31 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:31 devstack sudo[97240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:00:31 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:31 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Deleted volume successfully.
Nov 05 12:00:31 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d" returned: 0 in 0.582s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d150d7cd-114b-4c30-ba05-5bb9d3a1e032 tempest-VolumesCloneNegativeTest-898565462 None] Lock "cinder-885723db-d867-4524-bcab-88796f6373e1-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:31 devstack sudo[97246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 1G
Nov 05 12:00:31 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:32 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 1G" returned: 0 in 0.689s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe229219-c34f-4b9b-8a0b-783a16d6122d -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:32 devstack sudo[97252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe229219-c34f-4b9b-8a0b-783a16d6122d -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5
Nov 05 12:00:32 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:33 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe229219-c34f-4b9b-8a0b-783a16d6122d -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:33 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 is being set with open permissions: ugo+rw
Nov 05 12:00:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:33 devstack sudo[97258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5
Nov 05 12:00:33 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:33 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:33 devstack sudo[97262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.info
Nov 05 12:00:33 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:33 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.info" returned: 0 in 0.534s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:33 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.info is being set with open permissions: ugo+rw
Nov 05 12:00:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:33 devstack sudo[97301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.info
Nov 05 12:00:33 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:34 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.info" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.108s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fdd25de0-9cb1-4b56-a88c-0691c1b4cd7f tempest-SnapshotMetadataTestJSON-1173964799 None] Create snapshot completed successfully
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "cinder-52775f6d-b474-4b6a-8870-46712d5a42b5-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-52775f6d-b474-4b6a-8870-46712d5a42b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "cinder-quobyte-fe229219-c34f-4b9b-8a0b-783a16d6122d" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-quobyte-fe229219-c34f-4b9b-8a0b-783a16d6122d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "cinder-quobyte-52775f6d-b474-4b6a-8870-46712d5a42b5" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-quobyte-52775f6d-b474-4b6a-8870-46712d5a42b5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Deleting offline snapshot 52775f6d-b474-4b6a-8870-46712d5a42b5 of volume fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] snapshot_file for this snap is: volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84084cb-df1a-49c9-9a01-41a51e440867]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:38 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5
Nov 05 12:00:38 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:38 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5" returned: 0 in 0.957s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe229219-c34f-4b9b-8a0b-783a16d6122d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:00:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92540131-8787-40f7-a899-9bde4018f9fe]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:39 devstack sudo[97348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d
Nov 05 12:00:39 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:39 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d" returned: 0 in 0.822s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:39 devstack sudo[97366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5
Nov 05 12:00:39 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:40 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5" returned: 0 in 0.839s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:40 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5
Nov 05 12:00:40 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Flow 'volume_create_manager' (ed43da47-a092-4847-a22a-2ae2b0505fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce27720-2c9a-48f8-ae29-ea8552288002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce27720-2c9a-48f8-ae29-ea8552288002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-555221998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b1ea98-411f-4190-bc30-5d3670f895ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2225dbe5bc242b8afbf9eb170c157d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:41Z,use_quota=True,user_id='a4da0732dd7b4f9d9fa2b0aab9010701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3c884a-862a-4ff1-b573-0218bff6820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3c884a-862a-4ff1-b573-0218bff6820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381f43e3-d5e8-4683-8c9f-3dc5d60b4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:00:40 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d.52775f6d-b474-4b6a-8870-46712d5a42b5" returned: 0 in 0.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-quobyte-52775f6d-b474-4b6a-8870-46712d5a42b5" released by "_delete_snapshot" :: held 3.313s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-quobyte-fe229219-c34f-4b9b-8a0b-783a16d6122d" released by "delete_snapshot" :: held 3.356s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Created reservations ['0f71bc03-03a2-4edd-8fca-ec1712e9f691', 'c1fb5da9-27c5-4612-89fa-fab18723869e', '3739c69f-35a2-427e-8b22-5332135e0663', 'a0e395c2-e5de-4d35-ab2c-75c8b989a1ef'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Delete snapshot completed successfully.
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a5916881-d673-40bf-996d-f46a979a05e5 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-52775f6d-b474-4b6a-8870-46712d5a42b5-delete_snapshot" released by "delete_snapshot" :: held 3.701s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381f43e3-d5e8-4683-8c9f-3dc5d60b4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1b1ea98-411f-4190-bc30-5d3670f895ee', 'volume_name': 'volume-c1b1ea98-411f-4190-bc30-5d3670f895ee', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104541222d0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71909f73-8fc0-4694-b6b3-10ae861494e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71909f73-8fc0-4694-b6b3-10ae861494e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34959c7-66f9-4735-928c-94efbc0abc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Volume c1b1ea98-411f-4190-bc30-5d3670f895ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1b1ea98-411f-4190-bc30-5d3670f895ee', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104541222d0>}
Nov 05 12:00:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Trying to clone c1b1ea98-411f-4190-bc30-5d3670f895ee from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:00:42 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76399c14-0b07-479b-a189-347bffe528d8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "cinder-fe229219-c34f-4b9b-8a0b-783a16d6122d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-fe229219-c34f-4b9b-8a0b-783a16d6122d-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:42 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD
Nov 05 12:00:42 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "cinder-quobyte-fe229219-c34f-4b9b-8a0b-783a16d6122d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-quobyte-fe229219-c34f-4b9b-8a0b-783a16d6122d" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e48e34e-28fc-4252-af30-664f48e58229]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:42 devstack sudo[97400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d
Nov 05 12:00:42 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:42 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD" returned: 0 in 0.740s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:42 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 is fetched for user a4da0732dd7b4f9d9fa2b0aab9010701. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43407aab-8352-43cb-bd1f-9bf76f796dae]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:43 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d" returned: 0 in 0.586s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:43 devstack sudo[97410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d
Nov 05 12:00:43 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:43 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD
Nov 05 12:00:43 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:43 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fe229219-c34f-4b9b-8a0b-783a16d6122d" returned: 0 in 0.478s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-quobyte-fe229219-c34f-4b9b-8a0b-783a16d6122d" released by "delete_volume" :: held 1.306s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:43 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-555221998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b1ea98-411f-4190-bc30-5d3670f895ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2225dbe5bc242b8afbf9eb170c157d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:41Z,use_quota=True,user_id='a4da0732dd7b4f9d9fa2b0aab9010701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Creating volume c1b1ea98-411f-4190-bc30-5d3670f895ee {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:43 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:00:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:44 devstack sudo[97434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 1073741824
Nov 05 12:00:44 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:44 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Created reservations ['21f412ea-31f7-4db6-aca5-68df4935bf6b', '613fa9ef-cffe-4799-a943-ae096fb46998', 'e8097d62-9874-42e7-b342-be7ecbfb0afc', 'ada366bf-5524-4b3c-828c-536ef5cb82c5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:44 devstack sudo[97465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:00:44 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:45 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.110s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 1073741824" returned: 0 in 1.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:45 devstack sudo[97490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:00:45 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:45 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 1.003s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Deleted volume successfully.
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:45 devstack sudo[97493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee
Nov 05 12:00:45 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9aaeee0b-db0b-4116-b90b-1c2a16f8d836 tempest-SnapshotMetadataTestJSON-1173964799 None] Lock "cinder-fe229219-c34f-4b9b-8a0b-783a16d6122d-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:45 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.571s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:00:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:00:46 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:46 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Attempting download of 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume c1b1ea98-411f-4190-bc30-5d3670f895ee. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:00:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2def23a9-e617-47e4-969f-6d1c8a885fba]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_yfikyaoc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:46 devstack sudo[97502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_yfikyaoc
Nov 05 12:00:46 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:47 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_yfikyaoc" returned: 0 in 0.869s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_yfikyaoc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:47 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_yfikyaoc
Nov 05 12:00:47 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:47 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_yfikyaoc" returned: 1 in 0.848s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_yfikyaoc' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:00:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc341ba-4cf8-444a-8f4a-a974ec84acdf]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:48 devstack sudo[97510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD
Nov 05 12:00:48 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:48 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD" returned: 0 in 0.709s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:48 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] 97690ee3-6eec-4469-b729-e1fcbb2cb426 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:00:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:48 devstack sudo[97515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee
Nov 05 12:00:48 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:51 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee" returned: 0 in 3.057s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:51 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_yr4puam6devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:00:51 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Converted 112.00 MB image at 36.63 MB/s
Nov 05 12:00:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:51 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 1G
Nov 05 12:00:51 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:52 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 1G" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Downloaded image 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume c1b1ea98-411f-4190-bc30-5d3670f895ee successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 for user a4da0732dd7b4f9d9fa2b0aab9010701 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Marking volume c1b1ea98-411f-4190-bc30-5d3670f895ee as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Copying metadata from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 to c1b1ea98-411f-4190-bc30-5d3670f895ee. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Creating volume glance metadata for volume c1b1ea98-411f-4190-bc30-5d3670f895ee backed by image 97690ee3-6eec-4469-b729-e1fcbb2cb426 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34959c7-66f9-4735-928c-94efbc0abc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b1ea98-411f-4190-bc30-5d3670f895ee', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104541222d0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d345aef-14be-46f0-bc25-b1bc2dba38e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Volume volume-c1b1ea98-411f-4190-bc30-5d3670f895ee (c1b1ea98-411f-4190-bc30-5d3670f895ee): created successfully
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d345aef-14be-46f0-bc25-b1bc2dba38e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Flow 'volume_create_manager' (ed43da47-a092-4847-a22a-2ae2b0505fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5bb3a347-0e55-443c-84db-46238832b8ff tempest-VolumesExtendTest-249508247 None] Created volume successfully.
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad13c544-4655-45ac-956f-1961c0679dd8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:53 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee
Nov 05 12:00:53 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:53 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee" returned: 0 in 0.454s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 2G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee 2G" returned: 0 in 0.109s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.603s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2d8bc00c-c323-46c5-8910-8c2240c7ea5e tempest-VolumesExtendTest-249508247 None] Extend volume completed successfully.
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Acquiring lock "cinder-c1b1ea98-411f-4190-bc30-5d3670f895ee-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Lock "cinder-c1b1ea98-411f-4190-bc30-5d3670f895ee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Acquiring lock "cinder-quobyte-c1b1ea98-411f-4190-bc30-5d3670f895ee" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-c1b1ea98-411f-4190-bc30-5d3670f895ee" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23987c-7320-428a-bdc8-f0eb8dbd2de1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:55 devstack sudo[97582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee
Nov 05 12:00:55 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:55 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:55 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee
Nov 05 12:00:55 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:55 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c1b1ea98-411f-4190-bc30-5d3670f895ee" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-c1b1ea98-411f-4190-bc30-5d3670f895ee" released by "delete_volume" :: held 0.888s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Created reservations ['cedd8d59-d316-4243-9412-9738f362f84f', '44b4c65a-85ab-4015-8eb5-4c45505c837d', '685e08f0-e6fd-469c-b4b2-38b3f34937d0', '95bcdcab-9b01-432a-952a-48d65eab6410'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:56 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:00:56 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:56 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Flow 'volume_create_manager' (6383bca6-020a-4ce4-ab3b-f1ff97e07255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183f3f30-232d-47ed-8f10-c394a63d3146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.595s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183f3f30-232d-47ed-8f10-c394a63d3146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132138948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63f8523b174657873c4a4fff2e6117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:57Z,use_quota=True,user_id='cbb5485917ec496c91ec07346ad6c758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8fd152-f3c4-4b0a-8b9c-daf8f43302b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8fd152-f3c4-4b0a-8b9c-daf8f43302b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8532d3d4-15e2-405c-8c12-c9b71eb879dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8532d3d4-15e2-405c-8c12-c9b71eb879dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9', 'volume_name': 'volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5746ae0-5e42-44f0-b181-c44a9bf1ea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5746ae0-5e42-44f0-b181-c44a9bf1ea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35ca036-447e-4972-b146-a15775b19d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Volume 9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9', 'volume_size': 1}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132138948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63f8523b174657873c4a4fff2e6117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:57Z,use_quota=True,user_id='cbb5485917ec496c91ec07346ad6c758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Creating volume 9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:57 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Deleted volume successfully.
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da3dc1f6-b06f-4030-8305-f57c328d6c5a tempest-VolumesExtendTest-249508247 None] Lock "cinder-c1b1ea98-411f-4190-bc30-5d3670f895ee-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:57 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 1073741824
Nov 05 12:00:57 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:57 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 1073741824" returned: 0 in 0.598s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:57 devstack sudo[97635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9
Nov 05 12:00:57 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:58 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Flow 'volume_create_manager' (2c768dcb-ed77-4597-a17f-c38faa572dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6618f87f-6b14-4ac7-98d3-e89ed8373af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35ca036-447e-4972-b146-a15775b19d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825c3623-ab8f-4585-9193-cb0dbbbd82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6618f87f-6b14-4ac7-98d3-e89ed8373af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-965850672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaf8faa-c563-47d0-8df8-fd7ce406cf1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2225dbe5bc242b8afbf9eb170c157d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:58Z,use_quota=True,user_id='a4da0732dd7b4f9d9fa2b0aab9010701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9a298f-be94-4ccd-ba70-5a29c8d6b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9a298f-be94-4ccd-ba70-5a29c8d6b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7d50d-c928-4666-aed1-9f37aed4f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7d50d-c928-4666-aed1-9f37aed4f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eaf8faa-c563-47d0-8df8-fd7ce406cf1a', 'volume_name': 'volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac00bce-91d2-46b6-8fd3-392c22c383ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac00bce-91d2-46b6-8fd3-392c22c383ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c87681e-fbfc-4167-a3ff-f27968aec900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Volume 3eaf8faa-c563-47d0-8df8-fd7ce406cf1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a', 'volume_size': 1}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-965850672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaf8faa-c563-47d0-8df8-fd7ce406cf1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2225dbe5bc242b8afbf9eb170c157d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:58Z,use_quota=True,user_id='a4da0732dd7b4f9d9fa2b0aab9010701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Creating volume 3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Volume volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 (9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9): created successfully
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825c3623-ab8f-4585-9193-cb0dbbbd82a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Flow 'volume_create_manager' (6383bca6-020a-4ce4-ab3b-f1ff97e07255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:58 devstack sudo[97638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a 1073741824
Nov 05 12:00:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-956aa9ec-f35b-4f7e-99ab-85c8ffc59ae5 tempest-VolumesDeleteCascade-576000801 None] Created volume successfully.
Nov 05 12:00:58 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:58 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a 1073741824" returned: 0 in 0.592s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:58 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a
Nov 05 12:00:58 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:59 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" returned: 0 in 0.497s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c87681e-fbfc-4167-a3ff-f27968aec900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2279ce80-a2d7-4d91-9ec0-f1b2e02153f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Volume volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a (3eaf8faa-c563-47d0-8df8-fd7ce406cf1a): created successfully
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2279ce80-a2d7-4d91-9ec0-f1b2e02153f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Flow 'volume_create_manager' (2c768dcb-ed77-4597-a17f-c38faa572dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6f283085-2569-40c9-b6b5-2829ca7921e8 tempest-VolumesExtendTest-249508247 None] Created volume successfully.
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Flow 'volume_create_manager' (0e8934ee-fad3-487b-888d-94e13063b567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e49502-df4f-45d4-a185-33d54c9b2599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e49502-df4f-45d4-a185-33d54c9b2599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1353948934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893a55ac-9bf7-4564-b17a-33bfda8a3162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c42166bdec64372abf3f80b866a48c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:00Z,use_quota=True,user_id='1833afd056484ae69e27836f808b4446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec19978-c25d-4ed7-aeed-4bc08fbc1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec19978-c25d-4ed7-aeed-4bc08fbc1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec989ab-2539-4435-9062-97a563c524a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec989ab-2539-4435-9062-97a563c524a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '893a55ac-9bf7-4564-b17a-33bfda8a3162', 'volume_name': 'volume-893a55ac-9bf7-4564-b17a-33bfda8a3162', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0cc92e-3c24-4d43-ab5b-2e8b12e768cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0cc92e-3c24-4d43-ab5b-2e8b12e768cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da393d8e-daaa-4583-8565-a18bd6df4ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Volume 893a55ac-9bf7-4564-b17a-33bfda8a3162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-893a55ac-9bf7-4564-b17a-33bfda8a3162', 'volume_size': 1}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Creating offline snapshot 60fd2da5-5ada-4769-b1c8-ad813cd2ac12 of volume 9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efce48e-0e4b-4762-8f80-5e09a8ca3889]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:59 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9
Nov 05 12:00:59 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:00 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:00 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 1G
Nov 05 12:01:00 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:00 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 1G" returned: 0 in 0.626s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:00 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12
Nov 05 12:01:00 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:01 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:01 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 is being set with open permissions: ugo+rw
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:01 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12
Nov 05 12:01:01 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:01 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:01 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.info
Nov 05 12:01:01 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:01 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.info" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:01 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.info is being set with open permissions: ugo+rw
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:01 devstack sudo[97711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.info
Nov 05 12:01:01 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:01 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.info" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.265s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1353948934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893a55ac-9bf7-4564-b17a-33bfda8a3162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c42166bdec64372abf3f80b866a48c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:00Z,use_quota=True,user_id='1833afd056484ae69e27836f808b4446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Creating volume 893a55ac-9bf7-4564-b17a-33bfda8a3162 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:01 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:02 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162 1073741824
Nov 05 12:01:02 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-00fa66b6-0bd6-4432-9243-8c56b6427877 tempest-VolumesDeleteCascade-576000801 None] Create snapshot completed successfully
Nov 05 12:01:02 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162 1073741824" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:02 devstack sudo[97719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162
Nov 05 12:01:02 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:02 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.211s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Creating offline snapshot f863189a-4f9c-4c33-8b64-ea7eef84d366 of volume 3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da393d8e-daaa-4583-8565-a18bd6df4ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-893a55ac-9bf7-4564-b17a-33bfda8a3162', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44ccf21-ecb1-4831-b9b2-9e0d8449bb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6583b38-2b24-4336-9605-4d3ebb5a85d5]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Volume volume-893a55ac-9bf7-4564-b17a-33bfda8a3162 (893a55ac-9bf7-4564-b17a-33bfda8a3162): created successfully
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44ccf21-ecb1-4831-b9b2-9e0d8449bb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Flow 'volume_create_manager' (0e8934ee-fad3-487b-888d-94e13063b567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e59b4ce5-6b74-4b80-a31b-4363b1fd4c9c tempest-AttachVolumeNegativeTest-83723807 None] Created volume successfully.
Nov 05 12:01:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:02 devstack sudo[97722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a
Nov 05 12:01:02 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:03 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:03 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 1G
Nov 05 12:01:03 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:03 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 1G" returned: 0 in 0.470s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:03 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366
Nov 05 12:01:03 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:04 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366" returned: 0 in 0.346s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 is being set with open permissions: ugo+rw
Nov 05 12:01:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:04 devstack sudo[97743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366
Nov 05 12:01:04 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:04 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:04 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.info
Nov 05 12:01:04 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:04 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.info" returned: 0 in 0.308s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.info is being set with open permissions: ugo+rw
Nov 05 12:01:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:04 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.info
Nov 05 12:01:04 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-12947aeb-26de-4490-b72d-d8ef1ad31282 req-0317688d-198d-425a-8ec8-6339579e27d5 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:05 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.info" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.124s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Creating offline snapshot 1361eefc-b1fa-4bb9-bcf7-7517f956baba of volume 9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:01:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7aa04ef0-c532-4b3e-bb19-2ac93fcf6eee tempest-VolumesExtendTest-249508247 None] Create snapshot completed successfully
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d526c2aa-f4f9-4e0e-af12-9596dc87bf7c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:05 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12
Nov 05 12:01:05 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:05 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:05 devstack sudo[97765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba 1G
Nov 05 12:01:05 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:06 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba 1G" returned: 0 in 0.572s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:06 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba
Nov 05 12:01:06 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:06 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:06 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba is being set with open permissions: ugo+rw
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:06 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba
Nov 05 12:01:06 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:06 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.726s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-12947aeb-26de-4490-b72d-d8ef1ad31282 req-0317688d-198d-425a-8ec8-6339579e27d5 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-12947aeb-26de-4490-b72d-d8ef1ad31282 req-0317688d-198d-425a-8ec8-6339579e27d5 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.842s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2a63341d-38bd-410c-a4f1-707dd14b0f49 tempest-VolumesDeleteCascade-576000801 None] Create snapshot completed successfully
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38fc2bf-cc50-4398-a6b5-8d2d1627afab]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-12947aeb-26de-4490-b72d-d8ef1ad31282 req-0317688d-198d-425a-8ec8-6339579e27d5 tempest-AttachVolumeNegativeTest-83723807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-893a55ac-9bf7-4564-b17a-33bfda8a3162', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a53455f8-018e-410b-9ba6-71bec03ff24e', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:01:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-12947aeb-26de-4490-b72d-d8ef1ad31282 req-0317688d-198d-425a-8ec8-6339579e27d5 tempest-AttachVolumeNegativeTest-83723807 None] attachment_update completed successfully.
Nov 05 12:01:07 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a
Nov 05 12:01:07 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Performing cascade delete. {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-1361eefc-b1fa-4bb9-bcf7-7517f956baba-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-1361eefc-b1fa-4bb9-bcf7-7517f956baba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:07 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" returned: 0 in 0.544s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 2G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-1361eefc-b1fa-4bb9-bcf7-7517f956baba" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-1361eefc-b1fa-4bb9-bcf7-7517f956baba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Deleting offline snapshot 1361eefc-b1fa-4bb9-bcf7-7517f956baba of volume 9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] snapshot_file for this snap is: volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b7889c-aba9-485b-8091-0ec8fd2599a7]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 2G" returned: 0 in 0.177s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.763s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ff31aec7-124b-46d0-bc00-8e20c1016cec tempest-VolumesExtendTest-249508247 None] Extend volume completed successfully.
Nov 05 12:01:07 devstack sudo[98204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba
Nov 05 12:01:07 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:08 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba" returned: 0 in 0.543s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3785a-4f80-4a79-adff-7ef4465f3116]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:08 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12
Nov 05 12:01:08 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Acquiring lock "cinder-f863189a-4f9c-4c33-8b64-ea7eef84d366-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Lock "cinder-f863189a-4f9c-4c33-8b64-ea7eef84d366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Acquiring lock "cinder-quobyte-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Acquiring lock "cinder-quobyte-f863189a-4f9c-4c33-8b64-ea7eef84d366" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-f863189a-4f9c-4c33-8b64-ea7eef84d366" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Deleting offline snapshot f863189a-4f9c-4c33-8b64-ea7eef84d366 of volume 3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] snapshot_file for this snap is: volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7a23fb-58c6-4145-9803-2159725b729d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:08 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12" returned: 0 in 0.464s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:08 devstack sudo[98213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366
Nov 05 12:01:08 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:08 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba
Nov 05 12:01:08 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:08 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c35f0d-dfae-40dc-80e5-d1ac075ff7b9]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:08 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:09 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba
Nov 05 12:01:09 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:09 devstack sudo[98227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a
Nov 05 12:01:09 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:09 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.1361eefc-b1fa-4bb9-bcf7-7517f956baba" returned: 0 in 0.341s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:09 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" returned: 0 in 0.473s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-1361eefc-b1fa-4bb9-bcf7-7517f956baba" released by "_delete_snapshot" :: held 1.936s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" released by "delete_snapshot" :: held 1.979s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:09 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366
Nov 05 12:01:09 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Created reservations ['9387dc63-08b2-491a-a4f8-e02a7be0b5fd', '2df88bd4-ea35-45c2-8875-c02069c3237d', '0103e071-468c-46ec-89f4-56e608b996b7', '43b58d07-f657-4ddf-9383-09617cd9cba5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Delete snapshot completed successfully.
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-1361eefc-b1fa-4bb9-bcf7-7517f956baba-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-60fd2da5-5ada-4769-b1c8-ad813cd2ac12-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-60fd2da5-5ada-4769-b1c8-ad813cd2ac12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-60fd2da5-5ada-4769-b1c8-ad813cd2ac12" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-60fd2da5-5ada-4769-b1c8-ad813cd2ac12" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Deleting offline snapshot 60fd2da5-5ada-4769-b1c8-ad813cd2ac12 of volume 9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] snapshot_file for this snap is: volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d32b54-f4d7-47ba-a491-0d2dbd472be2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:09 devstack sudo[98244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12
Nov 05 12:01:09 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:09 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366" returned: 0 in 0.588s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:09 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366
Nov 05 12:01:10 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-5b17c834-1af3-4ce3-854c-d8330539d317 req-9af9b847-7f95-44f3-afee-3c05f06c7f44 tempest-AttachVolumeNegativeTest-83723807 None] Terminate volume connection completed successfully.
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-5b17c834-1af3-4ce3-854c-d8330539d317 req-9af9b847-7f95-44f3-afee-3c05f06c7f44 tempest-AttachVolumeNegativeTest-83723807 None] Deleting attachment a53455f8-018e-410b-9ba6-71bec03ff24e. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:01:10 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a.f863189a-4f9c-4c33-8b64-ea7eef84d366" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:10 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12" returned: 0 in 0.721s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-f863189a-4f9c-4c33-8b64-ea7eef84d366" released by "_delete_snapshot" :: held 2.134s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" released by "delete_snapshot" :: held 2.170s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bf73d5-e27e-4201-954a-9ad476069dfc]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:10 devstack sudo[98279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9
Nov 05 12:01:10 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Flow 'volume_create_manager' (30f0783c-9dfd-41a9-a4eb-8b13fb42fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f482e2-1ba7-448b-b98b-972aa7af16ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f482e2-1ba7-448b-b98b-972aa7af16ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-649160956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f75a9a1-2a6e-41c3-add8-5a4b87609254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146fcf9491514a4ebd96794d37b53588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:11Z,use_quota=True,user_id='bbf6ef4b1e7a49b2a0f132f25a71c64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a0747d-ac8a-4845-802c-5ae0588ee69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a0747d-ac8a-4845-802c-5ae0588ee69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fd7962-b2ae-4f9d-8d22-a18e6e5e49ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fd7962-b2ae-4f9d-8d22-a18e6e5e49ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f75a9a1-2a6e-41c3-add8-5a4b87609254', 'volume_name': 'volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c13b66-503f-4bb2-93a5-1f4ca359c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c13b66-503f-4bb2-93a5-1f4ca359c50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad07fe7-90f6-4b88-a8e9-ecef30ece7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Volume 7f75a9a1-2a6e-41c3-add8-5a4b87609254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254', 'volume_size': 1}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-649160956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f75a9a1-2a6e-41c3-add8-5a4b87609254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146fcf9491514a4ebd96794d37b53588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:11Z,use_quota=True,user_id='bbf6ef4b1e7a49b2a0f132f25a71c64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Creating volume 7f75a9a1-2a6e-41c3-add8-5a4b87609254 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:10 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Created reservations ['e55e2583-7b52-4f08-8186-591be9f3216e', '062ce2b0-eec7-4119-98a2-5d3efd0f2e97', '4913d329-97b3-4539-939a-ae2a34a98ae4', 'd1e60a50-cb94-4d9e-8bf6-bb5a42a622d7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:10 devstack sudo[98281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254 1073741824
Nov 05 12:01:10 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Delete snapshot completed successfully.
Nov 05 12:01:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e641511-9d36-431f-9c2b-9b7d1b7442bb tempest-VolumesExtendTest-249508247 None] Lock "cinder-f863189a-4f9c-4c33-8b64-ea7eef84d366-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:11 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" returned: 0 in 0.515s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:11 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12
Nov 05 12:01:11 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:11 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254 1073741824" returned: 0 in 0.690s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:11 devstack sudo[98312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254
Nov 05 12:01:11 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:11 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12" returned: 0 in 0.579s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:11 devstack sudo[98317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12
Nov 05 12:01:11 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Acquiring lock "cinder-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Lock "cinder-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Acquiring lock "cinder-quobyte-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:11 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" acquired by "delete_volume" :: waited 0.044s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad07fe7-90f6-4b88-a8e9-ecef30ece7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018e7ad0-d959-42b5-b27e-6698850558c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d6573-84c9-4d06-8015-741d6ef3ee8b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Volume volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254 (7f75a9a1-2a6e-41c3-add8-5a4b87609254): created successfully
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018e7ad0-d959-42b5-b27e-6698850558c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Flow 'volume_create_manager' (30f0783c-9dfd-41a9-a4eb-8b13fb42fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:12 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9.60fd2da5-5ada-4769-b1c8-ad813cd2ac12" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f7ed29bd-2ab6-4980-96ca-89df14e7faa2 tempest-AttachVolumeTestJSON-921537592 None] Created volume successfully.
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-60fd2da5-5ada-4769-b1c8-ad813cd2ac12" released by "_delete_snapshot" :: held 2.386s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" released by "delete_snapshot" :: held 2.409s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:12 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a
Nov 05 12:01:12 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Created reservations ['a415901a-a82a-499d-810e-608d20d8a88f', '02212adc-d277-4144-aa59-78d8aba269c1', 'a927c87d-1eec-46ca-a23a-67c73a7e9411', '37b5bd2a-2968-4e25-bb76-f252caaa0bee'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Delete snapshot completed successfully.
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-60fd2da5-5ada-4769-b1c8-ad813cd2ac12-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Snapshots deleted, issuing volume delete {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db08747d-9cf1-4cd6-b13c-992da3fc39ea]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:12 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" returned: 0 in 0.550s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:12 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9
Nov 05 12:01:12 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:12 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a
Nov 05 12:01:12 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:12 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" returned: 0 in 0.488s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:12 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9
Nov 05 12:01:12 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:12 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Lock "cinder-quobyte-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a" released by "delete_volume" :: held 1.064s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Created reservations ['8b10c087-6bfa-4496-a98e-7ea66503aca2', '0a6566f9-e265-4c34-9068-204a2f50d919', '61b0aa73-03d4-4389-bba6-b736845831e2', '90304cdc-fd57-4f3a-a64a-7e949312ed73'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:13 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:13 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:13 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9" released by "delete_volume" :: held 1.106s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Created reservations ['0c564371-22aa-495b-aec6-15e3d64fc368', '4ec7b243-03a6-4edd-8deb-d18aa3fb7568', '849da74e-a75a-4085-911d-9d3a919117e1', 'e0a69695-3a9f-44d9-b1ec-73941bfce5fc'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:13 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Deleted volume successfully.
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:13 devstack sudo[98357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79b5917c-22da-4c78-962b-73dd66dcd3b5 tempest-VolumesExtendTest-249508247 None] Lock "cinder-3eaf8faa-c563-47d0-8df8-fd7ce406cf1a-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:13 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-802cc3e4-2cb7-483e-ba92-e5d121b3d2b8 req-2e745773-c7b4-45f9-8771-b100ac3e16c5 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-802cc3e4-2cb7-483e-ba92-e5d121b3d2b8 req-2e745773-c7b4-45f9-8771-b100ac3e16c5 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-802cc3e4-2cb7-483e-ba92-e5d121b3d2b8 req-2e745773-c7b4-45f9-8771-b100ac3e16c5 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-802cc3e4-2cb7-483e-ba92-e5d121b3d2b8 req-2e745773-c7b4-45f9-8771-b100ac3e16c5 tempest-AttachVolumeTestJSON-921537592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cd8d96a-bcdb-4963-a15d-e38b17ac5778', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:01:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-802cc3e4-2cb7-483e-ba92-e5d121b3d2b8 req-2e745773-c7b4-45f9-8771-b100ac3e16c5 tempest-AttachVolumeTestJSON-921537592 None] attachment_update completed successfully.
Nov 05 12:01:14 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.468s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Deleted volume successfully.
Nov 05 12:01:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-061405cc-9102-4807-ac01-9b6ea9128ae2 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-9d8db7fa-b0fb-4b2e-a8f6-5d78ebcfb3c9-delete_volume" released by "delete_volume" :: held 6.897s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Flow 'volume_create_manager' (428164d4-fa6d-430e-a9d6-a2f4e3c2f876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7eae2e-fdc0-4600-a019-31d9c6fcf0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7eae2e-fdc0-4600-a019-31d9c6fcf0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-14056588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63f8523b174657873c4a4fff2e6117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:15Z,use_quota=True,user_id='cbb5485917ec496c91ec07346ad6c758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6c2829-68a4-403c-adc2-24cdb1c1adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6c2829-68a4-403c-adc2-24cdb1c1adeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6a313d-9bb7-44df-b31b-6f0978e02169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6a313d-9bb7-44df-b31b-6f0978e02169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab', 'volume_name': 'volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d82c3f-8cf5-416f-ad97-e5de2b5ecb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d82c3f-8cf5-416f-ad97-e5de2b5ecb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b63d113-3c92-44b8-b35b-0ac0929658a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Volume 7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab', 'volume_size': 1}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-14056588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63f8523b174657873c4a4fff2e6117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:15Z,use_quota=True,user_id='cbb5485917ec496c91ec07346ad6c758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Creating volume 7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:15 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:15 devstack sudo[98774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab 1073741824
Nov 05 12:01:15 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:15 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab 1073741824" returned: 0 in 0.564s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:15 devstack sudo[98780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab
Nov 05 12:01:15 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:16 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b63d113-3c92-44b8-b35b-0ac0929658a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbca2c2-d212-43d5-a974-4f2b45e32eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Volume volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab (7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab): created successfully
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbca2c2-d212-43d5-a974-4f2b45e32eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Flow 'volume_create_manager' (428164d4-fa6d-430e-a9d6-a2f4e3c2f876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c544428e-9855-4732-ab17-d728049c8b7b tempest-VolumesDeleteCascade-576000801 None] Created volume successfully.
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "cinder-893a55ac-9bf7-4564-b17a-33bfda8a3162-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-893a55ac-9bf7-4564-b17a-33bfda8a3162-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "cinder-quobyte-893a55ac-9bf7-4564-b17a-33bfda8a3162" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-quobyte-893a55ac-9bf7-4564-b17a-33bfda8a3162" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6c3763-e6e6-44e8-9423-1929dfe1b9a3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:16 devstack sudo[98783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162
Nov 05 12:01:16 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Flow 'volume_create_manager' (36782791-b9f2-40eb-b92b-447201bde424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f140fb-7b34-4a40-8ffb-0051ab1823b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f140fb-7b34-4a40-8ffb-0051ab1823b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1311321162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146fcf9491514a4ebd96794d37b53588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:17Z,use_quota=True,user_id='bbf6ef4b1e7a49b2a0f132f25a71c64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45d4be3-04f0-403e-a646-0cf9b29b9acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45d4be3-04f0-403e-a646-0cf9b29b9acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:16 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f314fd-642e-4843-b504-cd16c52cddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f314fd-642e-4843-b504-cd16c52cddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46', 'volume_name': 'volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f518a2-9f8a-4ea8-8cde-cf396cbd68a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f518a2-9f8a-4ea8-8cde-cf396cbd68a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bd63bd-4c93-413c-94f6-ffdd892aac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Volume 9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46', 'volume_size': 1}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1311321162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146fcf9491514a4ebd96794d37b53588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:17Z,use_quota=True,user_id='bbf6ef4b1e7a49b2a0f132f25a71c64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Creating volume 9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:17 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162" returned: 0 in 0.566s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:17 devstack sudo[98789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 1073741824
Nov 05 12:01:17 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:17 devstack sudo[98790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162
Nov 05 12:01:17 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:17 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-893a55ac-9bf7-4564-b17a-33bfda8a3162" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-quobyte-893a55ac-9bf7-4564-b17a-33bfda8a3162" released by "delete_volume" :: held 1.056s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Created reservations ['8a16dae4-707c-41c4-84ac-f16f3e5d61a1', 'd32b2cb7-684a-404c-b8ad-35e9ff295b8f', 'e9e4b700-5f24-456d-a1fb-003499d944e7', '1b16828b-49dd-41d4-865e-866507235280'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:17 devstack sudo[98798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:17 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:17 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 1073741824" returned: 0 in 0.718s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:17 devstack sudo[98800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46
Nov 05 12:01:17 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:17 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Deleted volume successfully.
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-393615ee-865d-41be-b59c-32c5f9f80d0c tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-893a55ac-9bf7-4564-b17a-33bfda8a3162-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:18 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46" returned: 0 in 0.336s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.567s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bd63bd-4c93-413c-94f6-ffdd892aac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7ea39b-8310-4b32-8cee-5d1449ea0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Creating offline snapshot 2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c of volume 7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:01:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Volume volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 (9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46): created successfully
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7ea39b-8310-4b32-8cee-5d1449ea0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Flow 'volume_create_manager' (36782791-b9f2-40eb-b92b-447201bde424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf99e9b0-8fa7-4d3b-8eb7-897096cdc2d1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-54b4f521-082f-4ff8-bd02-a5d85a0ee0c6 tempest-AttachVolumeTestJSON-921537592 None] Created volume successfully.
Nov 05 12:01:18 devstack sudo[98804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab
Nov 05 12:01:18 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:18 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:18 devstack sudo[98810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c 1G
Nov 05 12:01:18 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "cinder-7f513cdc-39db-4d02-ad15-1a9d1166f3b2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-7f513cdc-39db-4d02-ad15-1a9d1166f3b2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "cinder-quobyte-7f513cdc-39db-4d02-ad15-1a9d1166f3b2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-quobyte-7f513cdc-39db-4d02-ad15-1a9d1166f3b2" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9092f509-9ec0-4b05-87bb-20701118af9a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:19 devstack sudo[98812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2
Nov 05 12:01:19 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:19 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c 1G" returned: 0 in 0.655s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:19 devstack sudo[98821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c
Nov 05 12:01:19 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:19 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2" returned: 0 in 0.572s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:19 devstack sudo[98826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2
Nov 05 12:01:19 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:19 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f513cdc-39db-4d02-ad15-1a9d1166f3b2" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-quobyte-7f513cdc-39db-4d02-ad15-1a9d1166f3b2" released by "delete_volume" :: held 1.008s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:19 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:19 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c is being set with open permissions: ugo+rw
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:19 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c
Nov 05 12:01:19 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Created reservations ['c4b57b72-a14c-4675-bcf5-a0c26b40303e', 'f45e069a-9d60-4bc4-a474-716edea1e233', 'f41eb2e3-d9a6-462e-961d-4219177f9bd6', '9222a0ac-a715-4c9d-82e2-0132fed3eff2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Flow 'volume_create_manager' (6a5d820e-c86c-44e3-b208-646c4054a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9179cd-02c5-4269-b8fd-2b6bf8d283bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:20 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:20 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9179cd-02c5-4269-b8fd-2b6bf8d283bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1126296650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06dbcd89-a688-4f8c-8338-c847b6b6b51b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00db7791c8274ecebff120c33d7387ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:20Z,use_quota=True,user_id='5e7a9e4635bc4018b27bce4807c0be29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c09406-ba26-4b88-9d70-0f64bece1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c09406-ba26-4b88-9d70-0f64bece1160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc49c630-4ecf-4560-ab42-426fdac52920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc49c630-4ecf-4560-ab42-426fdac52920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06dbcd89-a688-4f8c-8338-c847b6b6b51b', 'volume_name': 'volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9fc19e-9baa-4b93-be63-eaa2f31c8f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9fc19e-9baa-4b93-be63-eaa2f31c8f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbaf223-9dbe-4c4b-b56f-07c5bf99e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Volume 06dbcd89-a688-4f8c-8338-c847b6b6b51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b', 'volume_size': 1}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4c6238e6-d415-4d3f-a063-9e4a66ccc321 req-9d7090a6-c28c-4611-a286-9b120e97253c tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:20 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:20 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.info
Nov 05 12:01:20 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:20 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Deleted volume successfully.
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4eb7f802-74c0-4081-8cc6-dd3893baf2e2 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-7f513cdc-39db-4d02-ad15-1a9d1166f3b2-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:20 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.info" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:20 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.info is being set with open permissions: ugo+rw
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:20 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.info
Nov 05 12:01:20 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:20 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.info" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1126296650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06dbcd89-a688-4f8c-8338-c847b6b6b51b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00db7791c8274ecebff120c33d7387ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:20Z,use_quota=True,user_id='5e7a9e4635bc4018b27bce4807c0be29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Creating volume 06dbcd89-a688-4f8c-8338-c847b6b6b51b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:20 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:20 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b 1073741824
Nov 05 12:01:20 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e8a129d2-fd37-4dc5-8068-6d92bebc073d tempest-VolumesDeleteCascade-576000801 None] Create snapshot completed successfully
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "cinder-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "cinder-quobyte-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-quobyte-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f50b70b-ef06-4181-9cf7-b065eaa4756c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:21 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b 1073741824" returned: 0 in 0.563s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:21 devstack sudo[98857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5
Nov 05 12:01:21 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:21 devstack sudo[98859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b
Nov 05 12:01:21 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:21 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4c6238e6-d415-4d3f-a063-9e4a66ccc321 req-9d7090a6-c28c-4611-a286-9b120e97253c tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.577s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:21 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbaf223-9dbe-4c4b-b56f-07c5bf99e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7261ce0-65ad-460e-806f-cef4b8f289b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:21 devstack sudo[98866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5
Nov 05 12:01:21 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4c6238e6-d415-4d3f-a063-9e4a66ccc321 req-9d7090a6-c28c-4611-a286-9b120e97253c tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:21 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Volume volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b (06dbcd89-a688-4f8c-8338-c847b6b6b51b): created successfully
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7261ce0-65ad-460e-806f-cef4b8f289b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Flow 'volume_create_manager' (6a5d820e-c86c-44e3-b208-646c4054a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e5c6a9d6-dc54-4ac2-9806-bfc1d9a7484f tempest-VolumesListTestJSON-1979830462 None] Created volume successfully.
Nov 05 12:01:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-4c6238e6-d415-4d3f-a063-9e4a66ccc321 req-9d7090a6-c28c-4611-a286-9b120e97253c tempest-AttachVolumeTestJSON-921537592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0db4f2c-9ee6-4f1e-b085-65051e2a0502', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:01:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-4c6238e6-d415-4d3f-a063-9e4a66ccc321 req-9d7090a6-c28c-4611-a286-9b120e97253c tempest-AttachVolumeTestJSON-921537592 None] attachment_update completed successfully.
Nov 05 12:01:22 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-quobyte-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5" released by "delete_volume" :: held 0.876s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Created reservations ['d466a6cd-ac35-4aa8-ac8a-8dc917c25f71', '88fe99fb-26b5-4ff6-b5ca-2f6be167fabc', '631ebb31-3350-4113-b00c-7e3b15ff36c1', '6b4baa4b-0556-45ff-b4f1-04c2a2ba7a06'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:22 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:22 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Flow 'volume_create_manager' (7041193a-0304-4059-afeb-3348cff9b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e7a10c-4064-4955-854c-993025ee48b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e7a10c-4064-4955-854c-993025ee48b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-26162173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baec0274-9bbf-4177-9f4c-254858892987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63f8523b174657873c4a4fff2e6117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:22Z,use_quota=True,user_id='cbb5485917ec496c91ec07346ad6c758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d1e019-c095-431e-95c7-ad31cff8adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d1e019-c095-431e-95c7-ad31cff8adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e555555-2a49-4bdd-ba0d-797fb0e9cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e555555-2a49-4bdd-ba0d-797fb0e9cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'baec0274-9bbf-4177-9f4c-254858892987', 'volume_name': 'volume-baec0274-9bbf-4177-9f4c-254858892987', 'volume_size': 1, 'snapshot_id': '2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc484261-f60a-410d-ae27-af1e1f7187be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc484261-f60a-410d-ae27-af1e1f7187be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb718ca8-467c-43bf-9014-c4355e15a9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Volume baec0274-9bbf-4177-9f4c-254858892987: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-baec0274-9bbf-4177-9f4c-254858892987', 'volume_size': 1, 'snapshot_id': '2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c'}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c-baec0274-9bbf-4177-9f4c-254858892987" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c-baec0274-9bbf-4177-9f4c-254858892987" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Creating volume baec0274-9bbf-4177-9f4c-254858892987 from snapshot 2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-baec0274-9bbf-4177-9f4c-254858892987" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-baec0274-9bbf-4177-9f4c-254858892987" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] snapshot: 2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c, volume: baec0274-9bbf-4177-9f4c-254858892987,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b6b2c-253c-4a1d-b540-7cab875bd550]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:22 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Deleted volume successfully.
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b2f9c97-169e-4cd9-b2bf-42de08e85234 tempest-AttachVolumeNegativeTest-83723807 None] Lock "cinder-1cf9ae5c-0bb2-41c0-a2ac-6cd989e9c6b5-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:23 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c
Nov 05 12:01:23 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Flow 'volume_create_manager' (d899c6e6-d8fa-4246-972c-d694fe29fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c2ce16-ff87-4620-b020-2896617d3c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c2ce16-ff87-4620-b020-2896617d3c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1062515072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808a1837-bc2d-46af-b875-513072d1e91d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00db7791c8274ecebff120c33d7387ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:23Z,use_quota=True,user_id='5e7a9e4635bc4018b27bce4807c0be29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf9bbe6-55e1-4094-b2f1-e1cc627ecf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf9bbe6-55e1-4094-b2f1-e1cc627ecf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0aa644-a601-48aa-be44-205d3becf906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0aa644-a601-48aa-be44-205d3becf906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808a1837-bc2d-46af-b875-513072d1e91d', 'volume_name': 'volume-808a1837-bc2d-46af-b875-513072d1e91d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5d1492-ebd9-4b08-97e1-927368d173c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5d1492-ebd9-4b08-97e1-927368d173c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8162200f-c323-4ff0-a106-a3c6323ff43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Volume 808a1837-bc2d-46af-b875-513072d1e91d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808a1837-bc2d-46af-b875-513072d1e91d', 'volume_size': 1}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:23 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" returned: 0 in 0.547s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12499dd-2058-4a5a-b56b-f4989164bfbd]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:23 devstack sudo[98883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab
Nov 05 12:01:23 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:24 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" returned: 0 in 0.516s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:01:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:01:24 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:01:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:24 devstack sudo[98888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987
Nov 05 12:01:24 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:24 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=127,cinder:UPDATE=135,cinder:INSERT=38,cinder:DELETE=12 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:01:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-343d82ad-76a4-47ad-a76b-8d4b7cfe9a5c req-d8e05d2b-35ea-4691-9b3c-db6c6e5f3e7a tempest-AttachVolumeTestJSON-921537592 None] Terminate volume connection completed successfully.
Nov 05 12:01:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-343d82ad-76a4-47ad-a76b-8d4b7cfe9a5c req-d8e05d2b-35ea-4691-9b3c-db6c6e5f3e7a tempest-AttachVolumeTestJSON-921537592 None] Deleting attachment 2cd8d96a-bcdb-4963-a15d-e38b17ac5778. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:01:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-b4fc1688-e157-4c56-8758-f77920b46e01 req-e0998363-e768-4aaf-9794-aa11a2479934 tempest-AttachVolumeTestJSON-921537592 None] Terminate volume connection completed successfully.
Nov 05 12:01:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-b4fc1688-e157-4c56-8758-f77920b46e01 req-e0998363-e768-4aaf-9794-aa11a2479934 tempest-AttachVolumeTestJSON-921537592 None] Deleting attachment f0db4f2c-9ee6-4f1e-b085-65051e2a0502. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:01:33 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987" returned: 0 in 9.052s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:01:33 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Converted 1024.00 MB image at 113.10 MB/s
Nov 05 12:01:33 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987 is being set with open permissions: ugo+rw
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:33 devstack sudo[98958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987
Nov 05 12:01:33 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:33 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987" returned: 0 in 0.370s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-baec0274-9bbf-4177-9f4c-254858892987" released by "_copy_volume_from_snapshot" :: held 10.647s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=140,cinder:UPDATE=135,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c-baec0274-9bbf-4177-9f4c-254858892987" released by "_create_volume_from_snapshot" :: held 10.753s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.784s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.048s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1062515072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808a1837-bc2d-46af-b875-513072d1e91d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00db7791c8274ecebff120c33d7387ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:23Z,use_quota=True,user_id='5e7a9e4635bc4018b27bce4807c0be29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Creating volume 808a1837-bc2d-46af-b875-513072d1e91d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:33 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:33 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d 1073741824
Nov 05 12:01:33 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb718ca8-467c-43bf-9014-c4355e15a9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baec0274-9bbf-4177-9f4c-254858892987', 'volume_size': 1, 'snapshot_id': '2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fef4b4-8dba-4298-bac7-92e6c44f9602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Volume volume-baec0274-9bbf-4177-9f4c-254858892987 (baec0274-9bbf-4177-9f4c-254858892987): created successfully
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fef4b4-8dba-4298-bac7-92e6c44f9602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Flow 'volume_create_manager' (7041193a-0304-4059-afeb-3348cff9b445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-373f141f-c55f-4682-92a2-44d0745821d9 tempest-VolumesDeleteCascade-576000801 None] Created volume successfully.
Nov 05 12:01:34 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d 1073741824" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:34 devstack sudo[98968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d
Nov 05 12:01:34 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:34 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d" returned: 0 in 0.305s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8162200f-c323-4ff0-a106-a3c6323ff43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808a1837-bc2d-46af-b875-513072d1e91d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464ae66d-fb9d-4acd-b8b8-97c44db250bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Volume volume-808a1837-bc2d-46af-b875-513072d1e91d (808a1837-bc2d-46af-b875-513072d1e91d): created successfully
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464ae66d-fb9d-4acd-b8b8-97c44db250bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Flow 'volume_create_manager' (d899c6e6-d8fa-4246-972c-d694fe29fe13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-34f89bd4-7a62-42ce-b403-98f89e670f98 tempest-VolumesListTestJSON-1979830462 None] Created volume successfully.
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Performing cascade delete. {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Deleting offline snapshot 2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c of volume 7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] snapshot_file for this snap is: volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a6031-26b1-4727-9051-eedbbb4bbfe4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:35 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c
Nov 05 12:01:35 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Flow 'volume_create_manager' (83e29c96-e893-4ae3-beec-ffb2ec85bce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b511e744-02de-460c-a758-f222d7609d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b511e744-02de-460c-a758-f222d7609d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-491876950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00db7791c8274ecebff120c33d7387ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:35Z,use_quota=True,user_id='5e7a9e4635bc4018b27bce4807c0be29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b182bdc0-8a74-4d0f-9ffe-44bb58c8dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b182bdc0-8a74-4d0f-9ffe-44bb58c8dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f21145-1504-4dea-adf0-92857e065977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f21145-1504-4dea-adf0-92857e065977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20', 'volume_name': 'volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4febfb0e-b120-4ee5-b416-8fc3eae4457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4febfb0e-b120-4ee5-b416-8fc3eae4457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68918d6a-4944-4615-b0a4-ba24015a54a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Volume 0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20', 'volume_size': 1}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-491876950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00db7791c8274ecebff120c33d7387ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:35Z,use_quota=True,user_id='5e7a9e4635bc4018b27bce4807c0be29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Creating volume 0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:35 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:35 devstack sudo[98973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 1073741824
Nov 05 12:01:35 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:35 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" returned: 0 in 0.488s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "cinder-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[61518638-9a46-4fc5-a7b2-0e65531d9ee7]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "cinder-quobyte-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-quobyte-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4148d9-8953-4d92-8961-431348951422]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:35 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab
Nov 05 12:01:35 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:36 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46
Nov 05 12:01:36 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:36 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 1073741824" returned: 0 in 0.642s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:36 devstack sudo[98990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20
Nov 05 12:01:36 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:36 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46" returned: 0 in 0.522s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:36 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46
Nov 05 12:01:36 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:36 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" returned: 0 in 0.754s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:36 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c
Nov 05 12:01:36 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:36 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68918d6a-4944-4615-b0a4-ba24015a54a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fa9b67-587d-4cc6-980e-00983c0d0fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Volume volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 (0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20): created successfully
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fa9b67-587d-4cc6-980e-00983c0d0fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Flow 'volume_create_manager' (83e29c96-e893-4ae3-beec-ffb2ec85bce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3c131b9c-1930-44d7-bddc-805953660544 tempest-VolumesListTestJSON-1979830462 None] Created volume successfully.
Nov 05 12:01:36 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-quobyte-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46" released by "delete_volume" :: held 0.967s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Flow 'volume_create_manager' (326adf38-60f1-4fc5-a2d2-cfa769b4a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9751a878-6675-4043-87b4-cd960244cc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9751a878-6675-4043-87b4-cd960244cc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1168442570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8724530-dc36-492c-a59f-246f9ffec90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6108031e514542cab04d716d8e6cb5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:37Z,use_quota=True,user_id='18d5a164af1a40458a35e5a5fa8bde79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd583357-f27e-478c-89d1-dcce3a5e514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd583357-f27e-478c-89d1-dcce3a5e514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4906e5b-708b-40c1-8aed-e277dd2bfbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4906e5b-708b-40c1-8aed-e277dd2bfbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8724530-dc36-492c-a59f-246f9ffec90c', 'volume_name': 'volume-e8724530-dc36-492c-a59f-246f9ffec90c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7beccf31-2e22-4c7b-a7b7-35c3044c7e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7beccf31-2e22-4c7b-a7b7-35c3044c7e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee5a379-d014-4647-8aee-5c0f103c8b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Volume e8724530-dc36-492c-a59f-246f9ffec90c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8724530-dc36-492c-a59f-246f9ffec90c', 'volume_size': 1}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1168442570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8724530-dc36-492c-a59f-246f9ffec90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6108031e514542cab04d716d8e6cb5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:37Z,use_quota=True,user_id='18d5a164af1a40458a35e5a5fa8bde79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Creating volume e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:36 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:36 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c 1073741824
Nov 05 12:01:36 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:36 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c
Nov 05 12:01:36 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Created reservations ['264946b5-3868-47ad-b596-f9b1b143eedf', 'bb5860b4-846a-4bf4-a88b-4c6332559508', '15777b5b-3fea-488a-b12e-34d86166b9ba', '8aa71ee3-6936-4215-afa1-a0c85c556b4a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:37 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:37 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:37 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab.2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c" released by "_delete_snapshot" :: held 2.184s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" released by "delete_snapshot" :: held 2.222s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Created reservations ['91ee947d-1fb0-4304-b4a6-f2d9492664aa', '39ebcd3b-13ca-4c95-a058-6ec49a773601', '1851cd91-fae5-4575-ab85-d10f97e63c6d', '5f00e63f-a913-4a16-bd31-bd4e834c2872'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:37 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Deleted volume successfully.
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b768dfa3-a12d-49db-b54c-dc819e5204e8 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-9d1fbcf0-0e91-4a94-9e08-0254e5aa9c46-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:37 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c 1073741824" returned: 0 in 0.557s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Delete snapshot completed successfully.
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-2ee7fdf4-d980-4b0e-b324-4b996b6c0e3c-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Snapshots deleted, issuing volume delete {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:37 devstack sudo[99018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c
Nov 05 12:01:37 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[994369d7-046d-4c52-8b38-afa18deec777]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:37 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab
Nov 05 12:01:37 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:37 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c" returned: 0 in 0.360s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee5a379-d014-4647-8aee-5c0f103c8b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8724530-dc36-492c-a59f-246f9ffec90c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f17660-c24d-4e9e-85c6-33bd46f4ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Volume volume-e8724530-dc36-492c-a59f-246f9ffec90c (e8724530-dc36-492c-a59f-246f9ffec90c): created successfully
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f17660-c24d-4e9e-85c6-33bd46f4ed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Flow 'volume_create_manager' (326adf38-60f1-4fc5-a2d2-cfa769b4a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-050f3a7f-119e-4e73-98d8-572ec77fd38a req-e793e64f-2c45-4678-891e-f56ac7257a56 tempest-VolumesSnapshotsTestJSON-1643460200 None] Created volume successfully.
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "cinder-7f75a9a1-2a6e-41c3-add8-5a4b87609254-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-7f75a9a1-2a6e-41c3-add8-5a4b87609254-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:38 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:38 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab
Nov 05 12:01:38 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "cinder-quobyte-7f75a9a1-2a6e-41c3-add8-5a4b87609254" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-quobyte-7f75a9a1-2a6e-41c3-add8-5a4b87609254" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb2c25-7298-475e-9662-3d7c92db794e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:38 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254
Nov 05 12:01:38 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:38 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" returned: 0 in 0.374s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab" released by "delete_volume" :: held 0.917s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Created reservations ['ff306c10-c70a-4ea6-9761-e1d03a55cfdb', '1b2c98bc-15f9-4927-b085-1a42c63b54b3', '6a187196-0c28-4f41-b1b2-5493af349181', '3c445a0f-e548-4e5a-8142-2f688032fde0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:38 devstack sudo[99035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:38 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:38 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254" returned: 0 in 0.524s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:38 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254
Nov 05 12:01:38 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:39 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Deleted volume successfully.
Nov 05 12:01:39 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7f75a9a1-2a6e-41c3-add8-5a4b87609254" returned: 0 in 0.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-quobyte-7f75a9a1-2a6e-41c3-add8-5a4b87609254" released by "delete_volume" :: held 0.985s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2c9f7c9f-4731-4cf1-82d5-053f3f51d475 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-7dcd7b0b-f2e2-4dfc-8402-4b23ac039cab-delete_volume" released by "delete_volume" :: held 4.251s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Created reservations ['5c746abb-8ad9-45d6-ab51-39682cf0e027', 'bb807022-c947-420d-b917-93b467995f97', 'f9f37232-06bf-4ab4-9d3f-256d672e5878', '821e9c89-ec78-4bfa-97a6-5509694a10b3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:39 devstack sudo[99041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:39 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Creating offline snapshot 219d9eba-ca7b-4f76-927a-77c5a478049b of volume e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac472d-e0e6-4cb5-963c-43c84fcd9eef]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:39 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c
Nov 05 12:01:39 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-baec0274-9bbf-4177-9f4c-254858892987-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:39 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-baec0274-9bbf-4177-9f4c-254858892987-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Deleted volume successfully.
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9c5b4233-7693-41ab-b52d-bd3f7641a841 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-7f75a9a1-2a6e-41c3-add8-5a4b87609254-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "cinder-quobyte-baec0274-9bbf-4177-9f4c-254858892987" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-baec0274-9bbf-4177-9f4c-254858892987" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5e0bb-850c-4282-bb3c-0044231dc433]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:40 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c" returned: 0 in 0.495s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:40 devstack sudo[99048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987
Nov 05 12:01:40 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:40 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b 1G
Nov 05 12:01:40 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "cinder-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "cinder-quobyte-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-quobyte-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:40 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987" returned: 0 in 0.527s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a353b18-9350-490d-a6d3-01b28e8bf5fe]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:40 devstack sudo[99059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987
Nov 05 12:01:40 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "cinder-2ba1400f-52cc-4f86-89d0-6895bb45462c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-2ba1400f-52cc-4f86-89d0-6895bb45462c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "cinder-quobyte-2ba1400f-52cc-4f86-89d0-6895bb45462c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-quobyte-2ba1400f-52cc-4f86-89d0-6895bb45462c" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:40 devstack sudo[99060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20
Nov 05 12:01:40 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1555fa98-c477-45ec-a307-c8b29b7e855b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:40 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b 1G" returned: 0 in 0.607s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8724530-dc36-492c-a59f-246f9ffec90c -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:40 devstack sudo[99064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8724530-dc36-492c-a59f-246f9ffec90c -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b
Nov 05 12:01:40 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:40 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c
Nov 05 12:01:40 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:40 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-baec0274-9bbf-4177-9f4c-254858892987" returned: 0 in 0.409s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-quobyte-baec0274-9bbf-4177-9f4c-254858892987" released by "delete_volume" :: held 1.004s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Created reservations ['b2e41281-dec6-481f-9c29-0435a9ff11cf', '35add91c-60fa-46c5-82f0-2cdadfeef893', 'dabe9843-6d24-4812-8691-2bb31927cbf1', '23ad9b0e-f678-4713-ba0f-45892092bdd3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:41 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20" returned: 0 in 0.511s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack sudo[99074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20
Nov 05 12:01:41 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8724530-dc36-492c-a59f-246f9ffec90c -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b" returned: 0 in 0.486s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b is being set with open permissions: ugo+rw
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack sudo[99085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:41 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c" returned: 0 in 0.533s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack sudo[99087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b
Nov 05 12:01:41 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c
Nov 05 12:01:41 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-quobyte-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20" released by "delete_volume" :: held 0.897s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Created reservations ['551a5e3e-439b-48d5-808e-c8fa97741e5d', '4cec9364-21dc-45bf-a38e-199ccd28df65', 'bc18c6ea-44b9-48b3-aa3d-7d7c5974ba06', 'bcd48ff8-3078-4835-aaf4-0d8a4d66eb65'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:41 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b" returned: 0 in 0.282s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:41 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Deleted volume successfully.
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2ba1400f-52cc-4f86-89d0-6895bb45462c" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.info
Nov 05 12:01:41 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-quobyte-2ba1400f-52cc-4f86-89d0-6895bb45462c" released by "delete_volume" :: held 0.945s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-19b535f7-5844-4629-ae02-e263173bc960 tempest-VolumesDeleteCascade-576000801 None] Lock "cinder-baec0274-9bbf-4177-9f4c-254858892987-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack sudo[99098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:41 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "cinder-808a1837-bc2d-46af-b875-513072d1e91d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-808a1837-bc2d-46af-b875-513072d1e91d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Created reservations ['1c433c6a-5a96-4c3b-a766-a3464004740a', 'b001f4cf-47b0-40c6-84cf-8ad116ffc82d', 'd98b1167-b68e-494a-8746-fa1abbd0a5ad', '8ad3c5b4-63ab-40ed-9264-a2c117af2dd2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "cinder-quobyte-808a1837-bc2d-46af-b875-513072d1e91d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-quobyte-808a1837-bc2d-46af-b875-513072d1e91d" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:41 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.info" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.info is being set with open permissions: ugo+rw
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8fe2a3-f3df-4f51-be07-f8a828dfc4fe]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:42 devstack sudo[99102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.info
Nov 05 12:01:42 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:42 devstack sudo[99104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:42 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:42 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.342s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Deleted volume successfully.
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9d9dc324-00a0-4a2f-be33-98278a7b4531 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-0540c19b-7e9f-4cf9-94d9-0bcb8bd5db20-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:42 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d
Nov 05 12:01:42 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:42 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.info" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.764s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:42 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Deleted volume successfully.
Nov 05 12:01:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-6da246ca-547e-4b4d-b3d9-defc68c03c41 req-61e58298-9b6a-4127-9b74-9cbd83270a9f tempest-VolumesSnapshotsTestJSON-1643460200 None] Create snapshot completed successfully
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-91e5108e-6c6c-47c2-8e92-984cc813a4e9 tempest-AttachVolumeTestJSON-921537592 None] Lock "cinder-2ba1400f-52cc-4f86-89d0-6895bb45462c-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:42 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d" returned: 0 in 0.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:42 devstack sudo[99113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d
Nov 05 12:01:42 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:42 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-808a1837-bc2d-46af-b875-513072d1e91d" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-quobyte-808a1837-bc2d-46af-b875-513072d1e91d" released by "delete_volume" :: held 0.836s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Created reservations ['1c55cfdf-4026-4b84-b384-b52d52f1d321', 'b0568b7e-c65b-4d78-83d4-4d868947d801', '2009b2a6-f524-44ac-900c-95f450f7b20f', '07bf2ff0-c239-4a55-82aa-3dbd15e28e9f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:42 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:42 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "cinder-219d9eba-ca7b-4f76-927a-77c5a478049b-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:43 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.412s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-219d9eba-ca7b-4f76-927a-77c5a478049b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "cinder-quobyte-e8724530-dc36-492c-a59f-246f9ffec90c" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Deleted volume successfully.
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-quobyte-e8724530-dc36-492c-a59f-246f9ffec90c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "cinder-quobyte-219d9eba-ca7b-4f76-927a-77c5a478049b" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-531e77a1-0290-41f7-ba54-1b328dd8b7ce tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-808a1837-bc2d-46af-b875-513072d1e91d-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-quobyte-219d9eba-ca7b-4f76-927a-77c5a478049b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Deleting offline snapshot 219d9eba-ca7b-4f76-927a-77c5a478049b of volume e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] snapshot_file for this snap is: volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8630227-943d-4cdc-839a-f009774cea83]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:43 devstack sudo[99122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b
Nov 05 12:01:43 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:44 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b" returned: 0 in 0.556s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8724530-dc36-492c-a59f-246f9ffec90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf9c6ee-e43c-4580-ad9f-2acb891097ec]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "cinder-06dbcd89-a688-4f8c-8338-c847b6b6b51b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-06dbcd89-a688-4f8c-8338-c847b6b6b51b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "cinder-quobyte-06dbcd89-a688-4f8c-8338-c847b6b6b51b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:44 devstack sudo[99128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c
Nov 05 12:01:44 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-quobyte-06dbcd89-a688-4f8c-8338-c847b6b6b51b" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6fd99-6343-43ce-bc70-897f319f39a9]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:44 devstack sudo[99130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b
Nov 05 12:01:44 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:44 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c" returned: 0 in 0.647s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:44 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b
Nov 05 12:01:44 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:44 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b" returned: 0 in 0.551s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:44 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b
Nov 05 12:01:44 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:45 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:45 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b
Nov 05 12:01:45 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:45 devstack sudo[99152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:45 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:45 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06dbcd89-a688-4f8c-8338-c847b6b6b51b" returned: 0 in 0.401s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-quobyte-06dbcd89-a688-4f8c-8338-c847b6b6b51b" released by "delete_volume" :: held 1.029s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Created reservations ['d8b90bd8-2e7e-4c6b-ad9c-e56a5ac23a3f', '8a6f1eb3-b4ac-454e-9ba1-34a64c4138ac', '980c5e05-d2bc-4cb1-946a-77268e48ae0c', '21ef49ec-54ff-40e4-b4da-bca49c4fec41'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:45 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c.219d9eba-ca7b-4f76-927a-77c5a478049b" returned: 0 in 0.487s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:45 devstack sudo[99158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:45 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:45 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.509s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-quobyte-219d9eba-ca7b-4f76-927a-77c5a478049b" released by "_delete_snapshot" :: held 2.290s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-quobyte-e8724530-dc36-492c-a59f-246f9ffec90c" released by "delete_snapshot" :: held 2.339s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.quota [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Created reservations ['bf524d33-53ab-4132-a6ae-ae74a770f582', 'a3c8a0a1-60ce-4a0d-88ad-2047d6c05905', '5672887e-8a0a-4bd7-b451-faf37e02d67a', 'f4a9c0c6-0e24-48ba-bf55-dee4b43f10cb'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Delete snapshot completed successfully.
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-a5d9695e-263c-4acb-bbe3-26f80da3c139 req-2a938c7b-1140-4ba4-b743-410f5600fb2d tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-219d9eba-ca7b-4f76-927a-77c5a478049b-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:45 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.326s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Deleted volume successfully.
Nov 05 12:01:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4b3dcbe3-40c3-418f-8651-fb79f9cc26f1 tempest-VolumesListTestJSON-1979830462 None] Lock "cinder-06dbcd89-a688-4f8c-8338-c847b6b6b51b-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "cinder-e8724530-dc36-492c-a59f-246f9ffec90c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-e8724530-dc36-492c-a59f-246f9ffec90c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "cinder-quobyte-e8724530-dc36-492c-a59f-246f9ffec90c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-quobyte-e8724530-dc36-492c-a59f-246f9ffec90c" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e69f352-e436-49dc-ad8b-9e3e447b7072]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:47 devstack sudo[99161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c
Nov 05 12:01:47 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:47 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c" returned: 0 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:47 devstack sudo[99167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c
Nov 05 12:01:47 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Flow 'volume_create_manager' (c88a7ed2-dde8-4569-b122-d0ccccbf514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b929c60-5e45-4373-9f10-c6416702873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b929c60-5e45-4373-9f10-c6416702873b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-809295493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6af452-4d97-42bc-85a2-fa2d6f4580f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcf64634a7e4d3f89379f7543c229f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:47Z,use_quota=True,user_id='5b9fb2f857b24d7da3cd46d36a11da34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478d063a-050f-481f-9788-2593e6b23ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478d063a-050f-481f-9788-2593e6b23ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878c39c4-394d-442c-804c-704ca2da61c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878c39c4-394d-442c-804c-704ca2da61c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6af452-4d97-42bc-85a2-fa2d6f4580f1', 'volume_name': 'volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bc73bb-0dec-472c-8e57-5ec092f5410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bc73bb-0dec-472c-8e57-5ec092f5410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bd00aa-2992-4e1f-87f6-2207f00fb60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Volume 0c6af452-4d97-42bc-85a2-fa2d6f4580f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1', 'volume_size': 1}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-809295493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6af452-4d97-42bc-85a2-fa2d6f4580f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcf64634a7e4d3f89379f7543c229f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:47Z,use_quota=True,user_id='5b9fb2f857b24d7da3cd46d36a11da34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Creating volume 0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:47 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:47 devstack sudo[99169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 1073741824
Nov 05 12:01:47 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:47 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8724530-dc36-492c-a59f-246f9ffec90c" returned: 0 in 0.429s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-quobyte-e8724530-dc36-492c-a59f-246f9ffec90c" released by "delete_volume" :: held 0.984s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:47 devstack cinder-volume[87184]: DEBUG cinder.quota [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Created reservations ['c9778d14-5a58-43be-b347-2930a4f5bb80', 'c8622470-94b9-43aa-a363-1b3a41d859b9', 'e10573fb-ca84-41cb-931e-9975f7d54cf6', 'd8b76ee6-d172-4421-ab32-43b871586179'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:48 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:01:48 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:48 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 1073741824" returned: 0 in 0.691s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:48 devstack sudo[99177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1
Nov 05 12:01:48 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:48 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.manager [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Deleted volume successfully.
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e4e3ccde-aeb5-4e52-bbd5-83b19f65a090 req-f056b586-0fcd-4cd3-a42c-544fc9376122 tempest-VolumesSnapshotsTestJSON-1643460200 None] Lock "cinder-e8724530-dc36-492c-a59f-246f9ffec90c-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:48 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" returned: 0 in 0.297s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bd00aa-2992-4e1f-87f6-2207f00fb60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0746e80-438a-472a-bdb1-8a5e8f6d25f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Volume volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 (0c6af452-4d97-42bc-85a2-fa2d6f4580f1): created successfully
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0746e80-438a-472a-bdb1-8a5e8f6d25f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Flow 'volume_create_manager' (c88a7ed2-dde8-4569-b122-d0ccccbf514f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b2e3bb7b-5a68-414c-952f-d00058febd4b tempest-VolumesCloneTest-467289419 None] Created volume successfully.
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Flow 'volume_create_manager' (b2d9e4fb-9260-4950-99e6-53fb20086622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467f933e-ad92-438f-82ac-1a8e6321dd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467f933e-ad92-438f-82ac-1a8e6321dd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1602245590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcf64634a7e4d3f89379f7543c229f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=0c6af452-4d97-42bc-85a2-fa2d6f4580f1,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:50Z,use_quota=True,user_id='5b9fb2f857b24d7da3cd46d36a11da34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1368a8a0-bede-4d4c-bb4d-f979444ecb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1368a8a0-bede-4d4c-bb4d-f979444ecb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f69f366-11f6-49e2-8860-de18345550f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f69f366-11f6-49e2-8860-de18345550f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4', 'volume_name': 'volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4', 'volume_size': 2, 'source_volid': '0c6af452-4d97-42bc-85a2-fa2d6f4580f1', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b8d437-91f4-4326-880c-a0618a8e7681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b8d437-91f4-4326-880c-a0618a8e7681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a859e8-d8fb-47d1-8f51-e9f007a31abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Volume a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4', 'volume_size': 2, 'source_volid': '0c6af452-4d97-42bc-85a2-fa2d6f4580f1', 'source_volstatus': 'available'}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:50 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Cloning volume 0c6af452-4d97-42bc-85a2-fa2d6f4580f1 to volume a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Creating offline snapshot 0aa12002-bc6f-4167-b13f-72644620336a of volume 0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f7d1c2-738d-4157-967b-125d3484a674]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:50 devstack sudo[99182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1
Nov 05 12:01:50 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:51 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" returned: 0 in 0.487s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:51 devstack sudo[99187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a 1G
Nov 05 12:01:51 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:51 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a 1G" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:51 devstack sudo[99193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a
Nov 05 12:01:51 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:51 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a" returned: 0 in 0.312s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:51 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a is being set with open permissions: ugo+rw
Nov 05 12:01:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:51 devstack sudo[99198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a
Nov 05 12:01:51 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:52 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a" returned: 0 in 0.282s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:52 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.info
Nov 05 12:01:52 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:52 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.info" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:52 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.info is being set with open permissions: ugo+rw
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:52 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.info
Nov 05 12:01:52 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:52 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.info" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Acquiring lock "cinder-quobyte-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] snapshot: 0aa12002-bc6f-4167-b13f-72644620336a, volume: a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd07635b-40f9-4370-9ada-cfdca2807a3a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:53 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a
Nov 05 12:01:53 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Flow 'volume_create_manager' (666fa398-3b0c-4d0d-b2b1-f1d6b6e4e0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84670c3c-6734-493a-8db9-1148511d97d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:53 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a" returned: 0 in 0.523s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84670c3c-6734-493a-8db9-1148511d97d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1690721497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733236da-3b5a-4585-94cd-74949671a928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5f91b832a945c6b0128c92debbded9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:53Z,use_quota=True,user_id='04aabe52e130474081794b32ef6f0ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea10bb4-f8a3-4dbd-aac0-881622d3db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea10bb4-f8a3-4dbd-aac0-881622d3db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4efb18a-2557-4094-9523-5ffce60d329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4efb18a-2557-4094-9523-5ffce60d329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733236da-3b5a-4585-94cd-74949671a928', 'volume_name': 'volume-733236da-3b5a-4585-94cd-74949671a928', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc1fedc-34bc-4ce0-9331-d3cb388a1257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc1fedc-34bc-4ce0-9331-d3cb388a1257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ceaf9d-561b-48b4-b8ca-0e51506c6402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Volume 733236da-3b5a-4585-94cd-74949671a928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733236da-3b5a-4585-94cd-74949671a928', 'volume_size': 2}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a86ad-0e24-4909-a818-20551068d361]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:53 devstack sudo[99218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1
Nov 05 12:01:53 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:53 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:01:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:53 devstack sudo[99223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4
Nov 05 12:01:53 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f78ac91-a318-44f3-a2fe-7973318fef84 tempest-BackendsCapabilitiesAdminTestsJSON-513308477 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4731140136719, 'free_capacity_gb': 1773.4731140136719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3e10be7-efe1-4757-a815-af507a5cf412 tempest-BackendsCapabilitiesAdminTestsJSON-513308477 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4731140136719, 'free_capacity_gb': 1773.4731140136719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Flow 'volume_create_manager' (4bd0cf82-0578-462a-88e7-dc25c08fb32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab47f2-d5b9-4490-afd2-393d07414c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab47f2-d5b9-4490-afd2-393d07414c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1030441790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d7ad77-108e-4321-804c-135e0e173870,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74e29b7bd3ab41099c3716d8f5d70628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:55Z,use_quota=True,user_id='6cbcd1b6bbec4b68a23a686a4e33976f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b620777-c7ab-48ae-86d7-50e0045041b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b620777-c7ab-48ae-86d7-50e0045041b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bd944a-8895-475b-8d12-343a5c195fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bd944a-8895-475b-8d12-343a5c195fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d7ad77-108e-4321-804c-135e0e173870', 'volume_name': 'volume-76d7ad77-108e-4321-804c-135e0e173870', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ca3e7b-169f-4b0f-be8a-29366e5b261c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ca3e7b-169f-4b0f-be8a-29366e5b261c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d6886f-00cb-4909-9266-a13a2e4beb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Volume 76d7ad77-108e-4321-804c-135e0e173870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d7ad77-108e-4321-804c-135e0e173870', 'volume_size': 1}
Nov 05 12:01:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:01 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" returned: 0 in 7.795s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:01 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:02:01 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Converted 1024.00 MB image at 131.36 MB/s
Nov 05 12:02:01 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 is being set with open permissions: ugo+rw
Nov 05 12:02:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:01 devstack sudo[99272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4
Nov 05 12:02:01 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:01 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" released by "_copy_volume_from_snapshot" :: held 9.133s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Acquiring lock "cinder-quobyte-0aa12002-bc6f-4167-b13f-72644620336a" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-0aa12002-bc6f-4167-b13f-72644620336a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Deleting offline snapshot 0aa12002-bc6f-4167-b13f-72644620336a of volume 0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] snapshot_file for this snap is: volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16371e2d-8194-4fdc-9cd2-88957c48bd95]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:02 devstack sudo[99275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a
Nov 05 12:02:02 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:02 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b066860-ef9c-4ae9-aed1-b1f8e63e6587]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:02 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1
Nov 05 12:02:02 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b1c18602-55e0-4776-a2f5-059cabd6e7c3 tempest-GroupSnapshotsV319Test-1313054676 None] Group tempest-GroupSnapshotsV319Test-Group-1574044483: creating
Nov 05 12:02:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b1c18602-55e0-4776-a2f5-059cabd6e7c3 tempest-GroupSnapshotsV319Test-1313054676 None] Group tempest-GroupSnapshotsV319Test-Group-1574044483: created successfully
Nov 05 12:02:03 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" returned: 0 in 0.548s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b1c18602-55e0-4776-a2f5-059cabd6e7c3 tempest-GroupSnapshotsV319Test-1313054676 None] Create group completed successfully.
Nov 05 12:02:03 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a
Nov 05 12:02:03 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:03 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:03 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a
Nov 05 12:02:03 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:03 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1.0aa12002-bc6f-4167-b13f-72644620336a" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-0aa12002-bc6f-4167-b13f-72644620336a" released by "_delete_snapshot" :: held 1.639s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.230s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.195s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1690721497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733236da-3b5a-4585-94cd-74949671a928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5f91b832a945c6b0128c92debbded9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:53Z,use_quota=True,user_id='04aabe52e130474081794b32ef6f0ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Creating volume 733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:03 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 2147483648 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:03 devstack sudo[99295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 2147483648
Nov 05 12:02:03 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a859e8-d8fb-47d1-8f51-e9f007a31abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4', 'volume_size': 2, 'source_volid': '0c6af452-4d97-42bc-85a2-fa2d6f4580f1', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d221a9-06c7-4d7d-ab85-dba75521c011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Volume volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 (a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4): created successfully
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d221a9-06c7-4d7d-ab85-dba75521c011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Flow 'volume_create_manager' (b2d9e4fb-9260-4950-99e6-53fb20086622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-45683231-fcc9-4a36-9c87-a3e0db2a6da2 tempest-VolumesCloneTest-467289419 None] Created volume successfully.
Nov 05 12:02:04 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 2147483648" returned: 0 in 0.530s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:04 devstack sudo[99301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928
Nov 05 12:02:04 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:04 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.642s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1030441790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d7ad77-108e-4321-804c-135e0e173870,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74e29b7bd3ab41099c3716d8f5d70628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:55Z,use_quota=True,user_id='6cbcd1b6bbec4b68a23a686a4e33976f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Creating volume 76d7ad77-108e-4321-804c-135e0e173870 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:04 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:04 devstack sudo[99304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870 1073741824
Nov 05 12:02:04 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ceaf9d-561b-48b4-b8ca-0e51506c6402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733236da-3b5a-4585-94cd-74949671a928', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752bf003-9c4b-4800-af60-910fd22f11d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Volume volume-733236da-3b5a-4585-94cd-74949671a928 (733236da-3b5a-4585-94cd-74949671a928): created successfully
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752bf003-9c4b-4800-af60-910fd22f11d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Flow 'volume_create_manager' (666fa398-3b0c-4d0d-b2b1-f1d6b6e4e0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f202fa4b-daee-4afa-b66f-3f31abc0a6da tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Created volume successfully.
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Flow 'volume_create_manager' (8c033eb9-902b-4386-8526-dbb7df12bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbf7de1-8136-4985-9116-75bab562738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbf7de1-8136-4985-9116-75bab562738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945875084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceb53906-c6fa-4301-b96f-b7a434778193,host='devstack@QuobyteHD#QuobyteHD',id=fedf8f0c-973a-476a-9f52-702737e8630f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc1ac52566244f8bae1fdfd27f77a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:05Z,use_quota=True,user_id='93e40c266663416ca26bf5b917d64ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e4a4115-dc9d-4fe2-8439-015d917e76ff),volume_type_id=2e4a4115-dc9d-4fe2-8439-015d917e76ff)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a65a47d-c82a-45a7-988a-94af8e18fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a65a47d-c82a-45a7-988a-94af8e18fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a028c9-2684-49ed-b001-c1e4a38af48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a028c9-2684-49ed-b001-c1e4a38af48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedf8f0c-973a-476a-9f52-702737e8630f', 'volume_name': 'volume-fedf8f0c-973a-476a-9f52-702737e8630f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f55f7c-dd13-4f64-b7e8-06ef687bdc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f55f7c-dd13-4f64-b7e8-06ef687bdc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b6728-f838-4373-b866-e34c80afdb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Volume fedf8f0c-973a-476a-9f52-702737e8630f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedf8f0c-973a-476a-9f52-702737e8630f', 'volume_size': 1}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Acquiring lock "cinder-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Lock "cinder-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Acquiring lock "cinder-quobyte-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[346fa023-a4a3-400d-9c68-165e358a0f05]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:05 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870 1073741824" returned: 0 in 0.559s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:05 devstack sudo[99309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4
Nov 05 12:02:05 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:05 devstack sudo[99312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870
Nov 05 12:02:05 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:05 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:05 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" returned: 0 in 0.414s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ceb53906-c6fa-4301-b96f-b7a434778193,created_at=2026-11-05T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945875084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceb53906-c6fa-4301-b96f-b7a434778193,host='devstack@QuobyteHD#QuobyteHD',id=fedf8f0c-973a-476a-9f52-702737e8630f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc1ac52566244f8bae1fdfd27f77a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:05Z,use_quota=True,user_id='93e40c266663416ca26bf5b917d64ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e4a4115-dc9d-4fe2-8439-015d917e76ff),volume_type_id=2e4a4115-dc9d-4fe2-8439-015d917e76ff)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Creating volume fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:05 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4
Nov 05 12:02:05 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:05 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f 1073741824
Nov 05 12:02:05 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d6886f-00cb-4909-9266-a13a2e4beb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d7ad77-108e-4321-804c-135e0e173870', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e144f57-b3d7-478b-8f69-47c9487f48fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Volume volume-76d7ad77-108e-4321-804c-135e0e173870 (76d7ad77-108e-4321-804c-135e0e173870): created successfully
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e144f57-b3d7-478b-8f69-47c9487f48fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Flow 'volume_create_manager' (4bd0cf82-0578-462a-88e7-dc25c08fb32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-99447b76-57d8-4022-905f-bb0572ded4aa req-982d2e30-f4d4-4a2d-b317-2f064d3beb0e tempest-VolumesGetTestJSON-993372783 None] Created volume successfully.
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:05 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4" released by "delete_volume" :: held 0.790s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Created reservations ['836c8f68-52c2-45d7-890c-a0bb83405caf', 'a08ac8fb-0bd4-4f2b-a44e-31445f75b1d0', '004c7528-bc6d-41a0-a0ff-d2576c960c64', 'bad51697-a8c7-4b2d-9070-f32ade782090'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:06 devstack sudo[99327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:06 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:06 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f 1073741824" returned: 0 in 0.551s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:06 devstack sudo[99330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f
Nov 05 12:02:06 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:06 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Acquiring lock "cinder-0c6af452-4d97-42bc-85a2-fa2d6f4580f1-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Deleted volume successfully.
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Lock "cinder-0c6af452-4d97-42bc-85a2-fa2d6f4580f1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45c46e18-c7d2-4569-b7a2-a5e2e5b67041 tempest-VolumesCloneTest-467289419 None] Lock "cinder-a6f84f0b-3954-4c5a-9895-e1aad1c1b8e4-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Acquiring lock "cinder-quobyte-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3d6849-3cf4-4b4e-8fa7-3abb8d93d101]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:06 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.772s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b6728-f838-4373-b866-e34c80afdb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedf8f0c-973a-476a-9f52-702737e8630f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33393588-7169-4847-b496-054daf854f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Creating offline snapshot 7384ebca-05c6-4893-99fb-2547b99ae065 of volume 733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:02:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Volume volume-fedf8f0c-973a-476a-9f52-702737e8630f (fedf8f0c-973a-476a-9f52-702737e8630f): created successfully
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33393588-7169-4847-b496-054daf854f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Flow 'volume_create_manager' (8c033eb9-902b-4386-8526-dbb7df12bd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27320998-a52d-42a2-9dcc-b8d688e66e8b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:06 devstack sudo[99334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1
Nov 05 12:02:06 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3bbf0641-a0c7-4e1d-8215-cacf4894a8dc tempest-GroupSnapshotsV319Test-1313054676 None] Created volume successfully.
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Acquiring lock "cinder-76d7ad77-108e-4321-804c-135e0e173870-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Lock "cinder-76d7ad77-108e-4321-804c-135e0e173870-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:06 devstack sudo[99335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928
Nov 05 12:02:06 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Acquiring lock "cinder-quobyte-76d7ad77-108e-4321-804c-135e0e173870" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Lock "cinder-quobyte-76d7ad77-108e-4321-804c-135e0e173870" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23f11e5-bc0c-4339-9504-1d509b5976f3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:06 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870
Nov 05 12:02:06 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:06 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" returned: 0 in 0.480s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:06 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1
Nov 05 12:02:06 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:07 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928" returned: 0 in 0.452s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 2G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:07 devstack sudo[99348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 2G
Nov 05 12:02:07 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:07 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:07 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870" returned: 0 in 0.472s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Lock "cinder-quobyte-0c6af452-4d97-42bc-85a2-fa2d6f4580f1" released by "delete_volume" :: held 0.878s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:07 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870
Nov 05 12:02:07 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Created reservations ['d5856620-6a2c-4e05-ab04-4db292825c02', '90e7b2e0-cce4-4b6c-ae42-74cc78b00613', 'bae2236c-7aae-4a4e-a6ed-4ef18b6013e2', 'c7b10cb5-cf12-424f-90e8-aecc24d81834'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] GroupSnapshot adb6626b-9002-4458-ac60-8aa601f5aab3: creating.
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Group snapshot adb6626b-9002-4458-ac60-8aa601f5aab3: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:07 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:07 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 2G" returned: 0 in 0.605s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733236da-3b5a-4585-94cd-74949671a928 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:07 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:07 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76d7ad77-108e-4321-804c-135e0e173870" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:07 devstack sudo[99362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733236da-3b5a-4585-94cd-74949671a928 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065
Nov 05 12:02:07 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Lock "cinder-quobyte-76d7ad77-108e-4321-804c-135e0e173870" released by "delete_volume" :: held 0.932s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.quota [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Created reservations ['24774bd9-9452-41f6-be3c-25088282524e', 'a7f65c69-31af-45ec-a832-cb811b9a8f38', 'e1254985-8af4-4f3e-a7c3-616a1584f95c', 'd5ecc805-ca95-4117-b4bf-b35b112c2bd9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:07 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:07 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:07 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:07 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Deleted volume successfully.
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67203461-8890-44cc-be18-e2921ff26de6 tempest-VolumesCloneTest-467289419 None] Lock "cinder-0c6af452-4d97-42bc-85a2-fa2d6f4580f1-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:08 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733236da-3b5a-4585-94cd-74949671a928 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:08 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 is being set with open permissions: ugo+rw
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:08 devstack sudo[99372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065
Nov 05 12:02:08 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:08 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG cinder.manager [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Deleted volume successfully.
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-f9884ea6-621b-4b4d-ade5-8dc02a2e4573 req-77f0ff24-adad-4da3-9e6c-50655131bb79 tempest-VolumesGetTestJSON-993372783 None] Lock "cinder-76d7ad77-108e-4321-804c-135e0e173870-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:08 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:08 devstack sudo[99376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.info
Nov 05 12:02:08 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:08 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.info" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:08 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.info is being set with open permissions: ugo+rw
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:08 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.info
Nov 05 12:02:08 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:08 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.info" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.303s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Creating offline snapshot ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd of volume fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:02:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8c708f7b-e4f2-4588-84bc-5da0491cb8f3 tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Create snapshot completed successfully
Nov 05 12:02:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23defa0-872e-4f2d-92dc-a89370a77840]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:09 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f
Nov 05 12:02:09 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:09 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:09 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd 1G
Nov 05 12:02:09 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:10 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd 1G" returned: 0 in 0.528s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedf8f0c-973a-476a-9f52-702737e8630f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:10 devstack sudo[99393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedf8f0c-973a-476a-9f52-702737e8630f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd
Nov 05 12:02:10 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "cinder-7384ebca-05c6-4893-99fb-2547b99ae065-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-7384ebca-05c6-4893-99fb-2547b99ae065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "cinder-quobyte-733236da-3b5a-4585-94cd-74949671a928" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-quobyte-733236da-3b5a-4585-94cd-74949671a928" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "cinder-quobyte-7384ebca-05c6-4893-99fb-2547b99ae065" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-quobyte-7384ebca-05c6-4893-99fb-2547b99ae065" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Deleting offline snapshot 7384ebca-05c6-4893-99fb-2547b99ae065 of volume 733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] snapshot_file for this snap is: volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6ef30-5d1c-4190-a101-fce511d6082e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:10 devstack sudo[99395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065
Nov 05 12:02:10 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:10 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fedf8f0c-973a-476a-9f52-702737e8630f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:10 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:10 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd
Nov 05 12:02:10 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:10 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065" returned: 0 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-733236da-3b5a-4585-94cd-74949671a928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f5c331-0827-46dc-b7ae-a4ece8b5c05c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:10 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" returned: 0 in 0.355s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:10 devstack sudo[99408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.info
Nov 05 12:02:10 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:10 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928
Nov 05 12:02:10 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:11 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.info" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:11 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:11 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.info
Nov 05 12:02:11 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:11 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:11 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065
Nov 05 12:02:11 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:11 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.info" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6b56226-5049-4689-993f-cc657598375b tempest-GroupSnapshotsV319Test-1313054676 None] group_snapshot adb6626b-9002-4458-ac60-8aa601f5aab3: created successfully
Nov 05 12:02:11 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:11 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065
Nov 05 12:02:11 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:11 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928.7384ebca-05c6-4893-99fb-2547b99ae065" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-quobyte-7384ebca-05c6-4893-99fb-2547b99ae065" released by "_delete_snapshot" :: held 1.750s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-quobyte-733236da-3b5a-4585-94cd-74949671a928" released by "delete_snapshot" :: held 1.783s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Created reservations ['30e7e96c-23a2-4b3e-aeee-10d1e8b1b1f9', '7fe4ce9f-afd9-418b-bca5-ebaa0eabd65a', '966c2d0c-5a02-4266-bca7-fc56711345b0', '52972b33-70c0-440b-8ee2-995368ade78f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Delete snapshot completed successfully.
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9625605c-fff8-41a2-b809-ef3c6399af1e tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-7384ebca-05c6-4893-99fb-2547b99ae065-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "cinder-733236da-3b5a-4585-94cd-74949671a928-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-733236da-3b5a-4585-94cd-74949671a928-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "cinder-quobyte-733236da-3b5a-4585-94cd-74949671a928" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-quobyte-733236da-3b5a-4585-94cd-74949671a928" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9449f37-e4ab-4276-8ef3-4b34423e03d0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Flow 'volume_create_manager' (39cf1a4f-728a-4697-9867-ed702d74394b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35c5fd4-d3eb-4f7a-b1e0-69aa229b6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35c5fd4-d3eb-4f7a-b1e0-69aa229b6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-357303243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0f6e29-15e2-40e2-b9b6-1dd610a8abca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d3f73b48c74a069820fd073c469574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:13Z,use_quota=True,user_id='65d95b8e86ee4e46875b2c07e2cbc626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f92e6a9-978f-4533-84ea-3da6568677c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:12 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928
Nov 05 12:02:12 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f92e6a9-978f-4533-84ea-3da6568677c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9fea1f-961a-440e-8d5e-0e23de73fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9fea1f-961a-440e-8d5e-0e23de73fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0f6e29-15e2-40e2-b9b6-1dd610a8abca', 'volume_name': 'volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b506fd-8741-43f5-a875-b2482848da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b506fd-8741-43f5-a875-b2482848da46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125c5833-684c-43a9-8cbb-9f125544513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Volume be0f6e29-15e2-40e2-b9b6-1dd610a8abca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca', 'volume_size': 1}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-357303243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0f6e29-15e2-40e2-b9b6-1dd610a8abca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d3f73b48c74a069820fd073c469574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:13Z,use_quota=True,user_id='65d95b8e86ee4e46875b2c07e2cbc626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Creating volume be0f6e29-15e2-40e2-b9b6-1dd610a8abca {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:12 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:12 devstack sudo[99429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca 1073741824
Nov 05 12:02:12 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] group_snapshot adb6626b-9002-4458-ac60-8aa601f5aab3: deleting
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] group_snapshot adb6626b-9002-4458-ac60-8aa601f5aab3: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Acquiring lock "cinder-quobyte-fedf8f0c-973a-476a-9f52-702737e8630f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Lock "cinder-quobyte-fedf8f0c-973a-476a-9f52-702737e8630f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Acquiring lock "cinder-quobyte-ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Lock "cinder-quobyte-ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Deleting offline snapshot ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd of volume fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:02:13 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] snapshot_file for this snap is: volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928" returned: 0 in 0.451s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5b3811-0b16-45d2-854b-5be7890d5778]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:13 devstack sudo[99434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928
Nov 05 12:02:13 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:13 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd
Nov 05 12:02:13 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:13 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-733236da-3b5a-4585-94cd-74949671a928" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:13 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca 1073741824" returned: 0 in 0.682s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-quobyte-733236da-3b5a-4585-94cd-74949671a928" released by "delete_volume" :: held 0.941s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:13 devstack sudo[99447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca
Nov 05 12:02:13 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Created reservations ['97cbdd75-0c4e-4648-a0cb-7e5c00944edc', '5be723c4-2792-44cc-91ea-5554258e4a06', '2680888e-1e45-4404-a965-d35c3f6f8c6d', '67339de2-3b69-47fd-bd63-16df75f84b3a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:13 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" returned: 0 in 0.539s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fedf8f0c-973a-476a-9f52-702737e8630f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee431b-0c2f-4c35-a889-450749b613ca]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:13 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:13 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:14 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f
Nov 05 12:02:14 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:14 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca" returned: 0 in 0.439s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125c5833-684c-43a9-8cbb-9f125544513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f46d6e-9728-4f02-a034-93b61d3a275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Volume volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca (be0f6e29-15e2-40e2-b9b6-1dd610a8abca): created successfully
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f46d6e-9728-4f02-a034-93b61d3a275e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Flow 'volume_create_manager' (39cf1a4f-728a-4697-9867-ed702d74394b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-23e0eacb-2bd5-425b-a3fd-4262e64a57e9 tempest-VolumesTestJSON-1716371756 None] Created volume successfully.
Nov 05 12:02:14 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Deleted volume successfully.
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a8583843-3c11-4200-8c07-3f661eec5b2d tempest-VolumesSnapshotNegativeTestJSON-182977137 None] Lock "cinder-733236da-3b5a-4585-94cd-74949671a928-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:14 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f" returned: 0 in 0.601s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:14 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd
Nov 05 12:02:14 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:14 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" returned: 0 in 0.465s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:14 devstack sudo[99464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd
Nov 05 12:02:14 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:15 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f.ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Lock "cinder-quobyte-ef87b2cb-7fe6-4270-9b84-dc7b119dbbbd" released by "_delete_snapshot" :: held 2.236s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Lock "cinder-quobyte-fedf8f0c-973a-476a-9f52-702737e8630f" released by "delete_snapshot" :: held 2.267s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:15 devstack cinder-volume[87184]: WARNING cinder.quota [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1321893292 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1321893292, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:15 devstack cinder-volume[87184]: WARNING cinder.quota [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1321893292 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1321893292, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] Created reservations ['c1282400-fcb8-4785-913f-289754cec654', '36bcdd45-fd19-4d5b-9e30-e4bafd0facf1', '7e1257d4-4b7e-4e4c-8e92-9c7f8a654d1f', 'f13ddcd1-ea0d-4d69-803c-f3f0a174b9f2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a151ef18-11d3-4875-a64b-33e8d917eb55 tempest-GroupSnapshotsV319Test-1313054676 None] group_snapshot adb6626b-9002-4458-ac60-8aa601f5aab3: deleted successfully
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Flow 'volume_create_manager' (8fece149-36ef-46e7-867f-f8ec358405e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02514227-f62e-4db0-a3c2-8e2af39997d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02514227-f62e-4db0-a3c2-8e2af39997d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-731162396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1543ceb7-326c-4303-a594-c68f468d9696,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d3f73b48c74a069820fd073c469574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:16Z,use_quota=True,user_id='65d95b8e86ee4e46875b2c07e2cbc626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918fba2a-c605-4ac7-8f7c-8b0a3c82a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918fba2a-c605-4ac7-8f7c-8b0a3c82a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f88acc-3025-4c87-b98c-51e7b58f9af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f88acc-3025-4c87-b98c-51e7b58f9af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1543ceb7-326c-4303-a594-c68f468d9696', 'volume_name': 'volume-1543ceb7-326c-4303-a594-c68f468d9696', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4faa59-0a5c-459f-ad27-1f930922b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4faa59-0a5c-459f-ad27-1f930922b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f7190c-94ac-425d-88ed-0159b1bdcbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Volume 1543ceb7-326c-4303-a594-c68f468d9696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1543ceb7-326c-4303-a594-c68f468d9696', 'volume_size': 1}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-731162396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1543ceb7-326c-4303-a594-c68f468d9696,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d3f73b48c74a069820fd073c469574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:16Z,use_quota=True,user_id='65d95b8e86ee4e46875b2c07e2cbc626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Creating volume 1543ceb7-326c-4303-a594-c68f468d9696 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:15 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:15 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696 1073741824
Nov 05 12:02:15 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:16 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696 1073741824" returned: 0 in 0.539s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:16 devstack sudo[99473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696
Nov 05 12:02:16 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:16 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f7190c-94ac-425d-88ed-0159b1bdcbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1543ceb7-326c-4303-a594-c68f468d9696', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75479e89-1eaa-4dbb-bd7f-88043cb2dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Volume volume-1543ceb7-326c-4303-a594-c68f468d9696 (1543ceb7-326c-4303-a594-c68f468d9696): created successfully
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75479e89-1eaa-4dbb-bd7f-88043cb2dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Flow 'volume_create_manager' (8fece149-36ef-46e7-867f-f8ec358405e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c44207dd-9c77-4240-877e-293e4eeeefbc tempest-VolumesTestJSON-1716371756 None] Created volume successfully.
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Acquiring lock "cinder-quobyte-fedf8f0c-973a-476a-9f52-702737e8630f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Lock "cinder-quobyte-fedf8f0c-973a-476a-9f52-702737e8630f" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f62bae4-544b-4ce6-bf19-270616785d15]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:17 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f
Nov 05 12:02:17 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:17 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:17 devstack sudo[99481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f
Nov 05 12:02:17 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:17 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fedf8f0c-973a-476a-9f52-702737e8630f" returned: 0 in 0.316s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Lock "cinder-quobyte-fedf8f0c-973a-476a-9f52-702737e8630f" released by "delete_volume" :: held 0.846s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Created reservations ['470d3053-4265-42c2-a110-3dc512e4be13'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:17 devstack cinder-volume[87184]: WARNING cinder.quota [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1321893292 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1321893292, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Created reservations ['1b25ea2f-dc77-4c20-a899-b31279f4bfb5', '31f785c6-44ac-4aeb-b00b-fa779efb5f99', 'ccdd9493-87e0-43a1-9c48-de2458e12f47', 'd679bcf2-7a31-4d06-a4ba-aa5fa2546ffd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:18 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:18 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:18 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.341s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a2d0d2dd-0d3d-4533-bf2e-6efaa37e847f tempest-GroupSnapshotsV319Test-1313054676 None] Delete group completed successfully.
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Flow 'volume_create_manager' (5ee0813c-2913-46bf-8dd2-d574dc5753c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387b791-d536-4db6-831c-9061a19d4a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387b791-d536-4db6-831c-9061a19d4a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-843284786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba92aa8-c861-4f1d-b89d-961c901035ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d3f73b48c74a069820fd073c469574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:19Z,use_quota=True,user_id='65d95b8e86ee4e46875b2c07e2cbc626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eeb769-378b-4e12-be13-b07623418d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eeb769-378b-4e12-be13-b07623418d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22b45d2-5055-48ba-a096-8c37d1c20729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22b45d2-5055-48ba-a096-8c37d1c20729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba92aa8-c861-4f1d-b89d-961c901035ee', 'volume_name': 'volume-aba92aa8-c861-4f1d-b89d-961c901035ee', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6435342d-5621-46c6-b44f-3f6a2031f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6435342d-5621-46c6-b44f-3f6a2031f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e8e221-64b5-491f-9673-c5d525caf59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Volume aba92aa8-c861-4f1d-b89d-961c901035ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba92aa8-c861-4f1d-b89d-961c901035ee', 'volume_size': 1}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-843284786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba92aa8-c861-4f1d-b89d-961c901035ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d3f73b48c74a069820fd073c469574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:19Z,use_quota=True,user_id='65d95b8e86ee4e46875b2c07e2cbc626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Creating volume aba92aa8-c861-4f1d-b89d-961c901035ee {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:18 devstack sudo[99487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee 1073741824
Nov 05 12:02:18 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:19 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee 1073741824" returned: 0 in 0.646s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:19 devstack sudo[99493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee
Nov 05 12:02:19 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:19 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e8e221-64b5-491f-9673-c5d525caf59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba92aa8-c861-4f1d-b89d-961c901035ee', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d4a837-a64a-4b14-ad57-b15988d86a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Volume volume-aba92aa8-c861-4f1d-b89d-961c901035ee (aba92aa8-c861-4f1d-b89d-961c901035ee): created successfully
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d4a837-a64a-4b14-ad57-b15988d86a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Flow 'volume_create_manager' (5ee0813c-2913-46bf-8dd2-d574dc5753c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-422e4303-2552-4849-a5b9-ac26d47058cf tempest-VolumesTestJSON-1716371756 None] Created volume successfully.
Nov 05 12:02:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "cinder-aba92aa8-c861-4f1d-b89d-961c901035ee-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-aba92aa8-c861-4f1d-b89d-961c901035ee-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "cinder-quobyte-aba92aa8-c861-4f1d-b89d-961c901035ee" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-quobyte-aba92aa8-c861-4f1d-b89d-961c901035ee" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c39606-e7d2-4846-b3a3-4fbf3fed1153]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:22 devstack sudo[99496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee
Nov 05 12:02:22 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:23 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee" returned: 0 in 0.526s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:23 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee
Nov 05 12:02:23 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Flow 'volume_create_manager' (68ad09bc-71d2-4bf7-b407-fbf0ddeab3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b16c74a-8520-47f7-8eab-9100dc9db7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b16c74a-8520-47f7-8eab-9100dc9db7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994bf3b2-f960-48f3-b868-6d75138fd045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cdc61d1e934a2fba316c97e0d0b7ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:23Z,use_quota=True,user_id='6a014084cc3c456690133fc0003583ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee7c4d64-7047-4969-afec-3a3f25257fa5),volume_type_id=ee7c4d64-7047-4969-afec-3a3f25257fa5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd3362-0865-4896-acfe-6b6dcc8c9cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd3362-0865-4896-acfe-6b6dcc8c9cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ef66ad-8f59-47e7-a865-a9639c87df3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:02:23 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-aba92aa8-c861-4f1d-b89d-961c901035ee" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-quobyte-aba92aa8-c861-4f1d-b89d-961c901035ee" released by "delete_volume" :: held 0.939s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Created reservations ['91c4a204-15f9-427b-8434-b48fac5ba7a9', 'ef3aa3a5-c260-405f-9a27-f4d2549eefb1', '5e028ca6-feca-4cd6-a830-8b6fc98d38ac', '39dd48bb-733a-4f42-b6e2-b3e83c0da1e7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:23 devstack sudo[99505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:23 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ef66ad-8f59-47e7-a865-a9639c87df3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '994bf3b2-f960-48f3-b868-6d75138fd045', 'volume_name': 'volume-994bf3b2-f960-48f3-b868-6d75138fd045', 'volume_size': 1, 'image_id': 'a1f218e6-ab9a-4996-893f-4efe48549f19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1f218e6-ab9a-4996-893f-4efe48549f19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007e3f5afe3e13bd83a205942d19763f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05cdc61d1e934a2fba316c97e0d0b7ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'decbc125df7e7d6c88579f9ced03bde72198cf24fad05aeb626b139a11df94a72e1939a0c60ff2201385831d9946e282f4a92066a0e986fb717d227f9e951663', 'id': 'a1f218e6-ab9a-4996-893f-4efe48549f19', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1f218e6-ab9a-4996-893f-4efe48549f19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea3d10>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8523d7a-909a-480d-bec2-0da0fec95be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8523d7a-909a-480d-bec2-0da0fec95be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db31bb60-dc7a-4a6f-98a3-a5381b4f085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Volume 994bf3b2-f960-48f3-b868-6d75138fd045: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-994bf3b2-f960-48f3-b868-6d75138fd045', 'volume_size': 1, 'image_id': 'a1f218e6-ab9a-4996-893f-4efe48549f19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1f218e6-ab9a-4996-893f-4efe48549f19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007e3f5afe3e13bd83a205942d19763f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05cdc61d1e934a2fba316c97e0d0b7ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'decbc125df7e7d6c88579f9ced03bde72198cf24fad05aeb626b139a11df94a72e1939a0c60ff2201385831d9946e282f4a92066a0e986fb717d227f9e951663', 'id': 'a1f218e6-ab9a-4996-893f-4efe48549f19', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1f218e6-ab9a-4996-893f-4efe48549f19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea3d10>}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Trying to clone 994bf3b2-f960-48f3-b868-6d75138fd045 from image a1f218e6-ab9a-4996-893f-4efe48549f19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1f218e6-ab9a-4996-893f-4efe48549f19', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:02:24 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.407s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Deleted volume successfully.
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-45b6b92f-117b-47b0-acd2-1afba61276f5 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-aba92aa8-c861-4f1d-b89d-961c901035ee-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:02:24 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[063c88cf-8efb-4e9b-828f-b6fdd221fbc3]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:24 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD
Nov 05 12:02:24 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:24 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "cinder-1543ceb7-326c-4303-a594-c68f468d9696-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-1543ceb7-326c-4303-a594-c68f468d9696-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=133,cinder:UPDATE=178,cinder:INSERT=39,cinder:DELETE=16 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "cinder-quobyte-1543ceb7-326c-4303-a594-c68f468d9696" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-quobyte-1543ceb7-326c-4303-a594-c68f468d9696" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98f3b2-9b2f-4e73-ae8d-e0cea783032f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:24 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD
Nov 05 12:02:24 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:25 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696
Nov 05 12:02:25 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:25 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD" returned: 1 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Temporary image a1f218e6-ab9a-4996-893f-4efe48549f19 is fetched for user 6a014084cc3c456690133fc0003583ee. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:02:25 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b9d5f7-6d9c-4647-a166-ac3a89ad74c8]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:25 devstack sudo[99522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696
Nov 05 12:02:25 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:25 devstack sudo[99524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD
Nov 05 12:02:25 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:25 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1543ceb7-326c-4303-a594-c68f468d9696" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-quobyte-1543ceb7-326c-4303-a594-c68f468d9696" released by "delete_volume" :: held 0.879s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:25 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Created reservations ['baf7704c-12fe-4455-bdfb-5ea4bf04d702', '7f86de89-f61a-43b7-bce0-4b0b88aa8c31', '9c879a6e-ded3-4574-a0e5-20880988c081', '8fe56207-e118-47bf-9751-478f03bf1819'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:25 devstack sudo[99530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD
Nov 05 12:02:25 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:25 devstack sudo[99531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:25 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "cinder-be0f6e29-15e2-40e2-b9b6-1dd610a8abca-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-be0f6e29-15e2-40e2-b9b6-1dd610a8abca-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "cinder-quobyte-be0f6e29-15e2-40e2-b9b6-1dd610a8abca" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-quobyte-be0f6e29-15e2-40e2-b9b6-1dd610a8abca" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e68ff9-0ed4-4095-9360-6261259737ed]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:26 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.411s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:26 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Deleted volume successfully.
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD" returned: 1 in 0.591s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994bf3b2-f960-48f3-b868-6d75138fd045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cdc61d1e934a2fba316c97e0d0b7ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:23Z,use_quota=True,user_id='6a014084cc3c456690133fc0003583ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee7c4d64-7047-4969-afec-3a3f25257fa5),volume_type_id=ee7c4d64-7047-4969-afec-3a3f25257fa5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Creating volume 994bf3b2-f960-48f3-b868-6d75138fd045 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:26 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:26 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca
Nov 05 12:02:26 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:26 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 1073741824
Nov 05 12:02:26 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd990aaf-e903-4c44-9eb3-3ec64b6ca263 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-1543ceb7-326c-4303-a594-c68f468d9696-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:26 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca" returned: 0 in 0.599s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:26 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca
Nov 05 12:02:26 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:27 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 1073741824" returned: 0 in 0.632s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:27 devstack sudo[99553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045
Nov 05 12:02:27 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:27 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-be0f6e29-15e2-40e2-b9b6-1dd610a8abca" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-quobyte-be0f6e29-15e2-40e2-b9b6-1dd610a8abca" released by "delete_volume" :: held 0.972s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Created reservations ['3ace1b42-99ab-4083-8634-6263fd23c338', '9be1267c-a3a2-44f6-9b5c-8dc0a4e7f616', 'b3aaaf03-8453-4cf2-a99c-452aae23478b', 'b0e77507-db17-40d5-ab4e-67c8acc7fe30'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:27 devstack sudo[99555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:27 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:27 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f966678b-98b7-4f53-af72-90d1d754d074 tempest-GroupsV320Test-872144546 None] Group tempest-GroupsV320Test-Group-1333669756: creating
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Attempting download of a1f218e6-ab9a-4996-893f-4efe48549f19 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1f218e6-ab9a-4996-893f-4efe48549f19', 'metadata': {}}])) to volume 994bf3b2-f960-48f3-b868-6d75138fd045. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:02:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f966678b-98b7-4f53-af72-90d1d754d074 tempest-GroupsV320Test-872144546 None] Group tempest-GroupsV320Test-Group-1333669756: created successfully
Nov 05 12:02:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f966678b-98b7-4f53-af72-90d1d754d074 tempest-GroupsV320Test-872144546 None] Create group completed successfully.
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b4c95-601b-42a1-a328-c4a4598bddfc]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1f218e6-ab9a-4996-893f-4efe48549f19_ai6o6qj8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:27 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.316s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Deleted volume successfully.
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8a7d3b2-6377-42b6-943b-28d91155e1a0 tempest-VolumesTestJSON-1716371756 None] Lock "cinder-be0f6e29-15e2-40e2-b9b6-1dd610a8abca-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:27 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1f218e6-ab9a-4996-893f-4efe48549f19_ai6o6qj8
Nov 05 12:02:27 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:27 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1f218e6-ab9a-4996-893f-4efe48549f19_ai6o6qj8" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1f218e6-ab9a-4996-893f-4efe48549f19_ai6o6qj8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:28 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1f218e6-ab9a-4996-893f-4efe48549f19_ai6o6qj8
Nov 05 12:02:28 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:28 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1f218e6-ab9a-4996-893f-4efe48549f19_ai6o6qj8" returned: 1 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1f218e6-ab9a-4996-893f-4efe48549f19_ai6o6qj8' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7effa2-2933-451e-b0ca-ec1a0d54755a]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:28 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD
Nov 05 12:02:28 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:28 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:28 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD
Nov 05 12:02:28 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:29 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] a1f218e6-ab9a-4996-893f-4efe48549f19 was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:29 devstack sudo[99578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045
Nov 05 12:02:29 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Created reservations ['64454be8-45ee-4d62-a73a-22036775b966'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:29 devstack sudo[99580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:29 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:29 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-92a01317-4dfe-4983-9706-68b85894182c tempest-GroupsV320Test-872144546 None] Delete group completed successfully.
Nov 05 12:02:29 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045" returned: 0 in 0.724s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1f218e6-ab9a-4996-893f-4efe48549f19_9hncpxh5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:02:29 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:02:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:29 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 1G
Nov 05 12:02:29 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:30 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 1G" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Downloaded image a1f218e6-ab9a-4996-893f-4efe48549f19 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1f218e6-ab9a-4996-893f-4efe48549f19', 'metadata': {}}])) to volume 994bf3b2-f960-48f3-b868-6d75138fd045 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Temporary image a1f218e6-ab9a-4996-893f-4efe48549f19 for user 6a014084cc3c456690133fc0003583ee is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Marking volume 994bf3b2-f960-48f3-b868-6d75138fd045 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Copying metadata from image a1f218e6-ab9a-4996-893f-4efe48549f19 to 994bf3b2-f960-48f3-b868-6d75138fd045. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Creating volume glance metadata for volume 994bf3b2-f960-48f3-b868-6d75138fd045 backed by image a1f218e6-ab9a-4996-893f-4efe48549f19 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a1f218e6-ab9a-4996-893f-4efe48549f19', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '007e3f5afe3e13bd83a205942d19763f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db31bb60-dc7a-4a6f-98a3-a5381b4f085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994bf3b2-f960-48f3-b868-6d75138fd045', 'volume_size': 1, 'image_id': 'a1f218e6-ab9a-4996-893f-4efe48549f19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1f218e6-ab9a-4996-893f-4efe48549f19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007e3f5afe3e13bd83a205942d19763f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05cdc61d1e934a2fba316c97e0d0b7ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'decbc125df7e7d6c88579f9ced03bde72198cf24fad05aeb626b139a11df94a72e1939a0c60ff2201385831d9946e282f4a92066a0e986fb717d227f9e951663', 'id': 'a1f218e6-ab9a-4996-893f-4efe48549f19', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1f218e6-ab9a-4996-893f-4efe48549f19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea3d10>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2ae361-50f7-450b-833c-88c018a52288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Volume volume-994bf3b2-f960-48f3-b868-6d75138fd045 (994bf3b2-f960-48f3-b868-6d75138fd045): created successfully
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2ae361-50f7-450b-833c-88c018a52288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Flow 'volume_create_manager' (68ad09bc-71d2-4bf7-b407-fbf0ddeab3ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-470b77f9-eb6d-4e3c-937d-7d04b7bc9495 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Created volume successfully.
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Acquiring lock "cinder-994bf3b2-f960-48f3-b868-6d75138fd045-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "cinder-994bf3b2-f960-48f3-b868-6d75138fd045-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Acquiring lock "cinder-quobyte-994bf3b2-f960-48f3-b868-6d75138fd045" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "cinder-quobyte-994bf3b2-f960-48f3-b868-6d75138fd045" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d8eb6-ed29-4b22-935c-926a7564da01]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:31 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045
Nov 05 12:02:31 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:31 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045" returned: 0 in 0.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:31 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045
Nov 05 12:02:31 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:31 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-994bf3b2-f960-48f3-b868-6d75138fd045" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "cinder-quobyte-994bf3b2-f960-48f3-b868-6d75138fd045" released by "delete_volume" :: held 0.833s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:31 devstack cinder-volume[87184]: WARNING cinder.quota [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:31 devstack cinder-volume[87184]: WARNING cinder.quota [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Created reservations ['ee6f2fae-867a-4985-9460-603bdd8961e5', '8bee0d44-f564-4e86-9b62-40afe8c82a0b', '474fba9d-9ddc-44bf-b6a4-647145aa7d56', '74412b43-e4d6-4c96-8678-3bba432592d6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:32 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:32 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:32 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.411s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Deleted volume successfully.
Nov 05 12:02:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cce3d0b-9b80-42bf-b55f-67796e186811 tempest-VolumeAndVolumeTypeFromImageTest-864608489 None] Lock "cinder-994bf3b2-f960-48f3-b868-6d75138fd045-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-58d12223-600e-4ccb-90d3-77f9d43e1b4f tempest-GroupsTest-1984115045 None] Group tempest-Group1-1512156305: creating
Nov 05 12:02:35 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=182,cinder:UPDATE=231,cinder:INSERT=66,cinder:DELETE=16 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:02:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-58d12223-600e-4ccb-90d3-77f9d43e1b4f tempest-GroupsTest-1984115045 None] Group tempest-Group1-1512156305: created successfully
Nov 05 12:02:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-58d12223-600e-4ccb-90d3-77f9d43e1b4f tempest-GroupsTest-1984115045 None] Create group completed successfully.
Nov 05 12:02:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0a7e9ce7-1df7-42f7-a1da-262e5adcccc4 tempest-GroupsTest-1984115045 None] Group tempest-Group2-2091574813: creating
Nov 05 12:02:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0a7e9ce7-1df7-42f7-a1da-262e5adcccc4 tempest-GroupsTest-1984115045 None] Group tempest-Group2-2091574813: created successfully
Nov 05 12:02:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0a7e9ce7-1df7-42f7-a1da-262e5adcccc4 tempest-GroupsTest-1984115045 None] Create group completed successfully.
Nov 05 12:02:38 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Flow 'volume_create_manager' (dba059a1-b1c3-4065-9c03-d2b7d89eea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e030b8e3-593a-4876-ae76-f8ff179ac3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e030b8e3-593a-4876-ae76-f8ff179ac3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1368843448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f6254d2-e9f3-4c94-811b-a483bc92696d,host='devstack@QuobyteHD#QuobyteHD',id=94ebae5f-c8a1-45a9-9244-7d1e8600f631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5dfa6b6727422186d0db39b7737ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:39Z,use_quota=True,user_id='c0c0d205b41948e99d627db61cbbda7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dabd1fc8-2cfb-47bb-8c41-0e71f9dc7c2f),volume_type_id=dabd1fc8-2cfb-47bb-8c41-0e71f9dc7c2f)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6590bb50-922e-4f4d-afce-219447ee20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6590bb50-922e-4f4d-afce-219447ee20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fa0f97-b816-48e6-b005-608447a048e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fa0f97-b816-48e6-b005-608447a048e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ebae5f-c8a1-45a9-9244-7d1e8600f631', 'volume_name': 'volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5748dcff-afcb-4234-b16d-b105831904b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5748dcff-afcb-4234-b16d-b105831904b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc8fb28-499f-47eb-8edc-dab388b9f1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Volume 94ebae5f-c8a1-45a9-9244-7d1e8600f631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631', 'volume_size': 1}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0f6254d2-e9f3-4c94-811b-a483bc92696d,created_at=2026-11-05T11:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1368843448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f6254d2-e9f3-4c94-811b-a483bc92696d,host='devstack@QuobyteHD#QuobyteHD',id=94ebae5f-c8a1-45a9-9244-7d1e8600f631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5dfa6b6727422186d0db39b7737ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:39Z,use_quota=True,user_id='c0c0d205b41948e99d627db61cbbda7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dabd1fc8-2cfb-47bb-8c41-0e71f9dc7c2f),volume_type_id=dabd1fc8-2cfb-47bb-8c41-0e71f9dc7c2f)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Creating volume 94ebae5f-c8a1-45a9-9244-7d1e8600f631 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:39 devstack sudo[99605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631 1073741824
Nov 05 12:02:39 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:39 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631 1073741824" returned: 0 in 0.696s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:39 devstack sudo[99611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631
Nov 05 12:02:39 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:40 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc8fb28-499f-47eb-8edc-dab388b9f1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fee8a7-90ad-403e-bbf7-6053357b2216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Volume volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631 (94ebae5f-c8a1-45a9-9244-7d1e8600f631): created successfully
Nov 05 12:02:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fee8a7-90ad-403e-bbf7-6053357b2216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Flow 'volume_create_manager' (dba059a1-b1c3-4065-9c03-d2b7d89eea01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-13f0fa84-2ee2-4d61-96e9-8b132ab2c289 tempest-GroupsTest-1984115045 None] Created volume successfully.
Nov 05 12:02:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Acquiring lock "cinder-quobyte-94ebae5f-c8a1-45a9-9244-7d1e8600f631" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Lock "cinder-quobyte-94ebae5f-c8a1-45a9-9244-7d1e8600f631" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b643b9c-a56b-4630-988e-c6e94bfcf411]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:42 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631
Nov 05 12:02:42 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:43 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631" returned: 0 in 0.635s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:43 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631
Nov 05 12:02:43 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:43 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-94ebae5f-c8a1-45a9-9244-7d1e8600f631" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Lock "cinder-quobyte-94ebae5f-c8a1-45a9-9244-7d1e8600f631" released by "delete_volume" :: held 1.191s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Created reservations ['dd86222e-43dc-43ee-9c5d-da2e71c4d92f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:43 devstack cinder-volume[87184]: WARNING cinder.quota [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-157956390 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-157956390, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:43 devstack cinder-volume[87184]: WARNING cinder.quota [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-157956390 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-157956390, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Created reservations ['9b16daff-8ed9-46e4-8406-635e6ccc1fc9', '8a6339c7-9003-49e9-8973-e9f13cc65632', '4720fe86-0df5-4ddf-8152-d8620df659d2', '1aa25663-299f-4962-9ec3-7de5b1115b5d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:43 devstack sudo[99631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:43 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Flow 'volume_create_manager' (a9db0ede-027f-4cdf-a9e6-657afc780b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bee99f1-f393-4c49-9159-89769e67241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bee99f1-f393-4c49-9159-89769e67241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b5f81d-88dd-4570-93e8-21f68b44bb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f2da0934a344019ad8e16500be0a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:44Z,use_quota=True,user_id='e6ce8e24fdf84dea96d7b15ded806c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57d86de-f2aa-4948-b41b-ec0d833d9ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57d86de-f2aa-4948-b41b-ec0d833d9ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec670903-90de-4e88-94b1-4e3fab5b78f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:02:44 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.326s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fce9d61d-7d99-4b1c-90ff-2563d79b0241 tempest-GroupsTest-1984115045 None] Delete group completed successfully.
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec670903-90de-4e88-94b1-4e3fab5b78f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26b5f81d-88dd-4570-93e8-21f68b44bb0d', 'volume_name': 'volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d', 'volume_size': 1, 'image_id': '6629d115-2e33-4f4d-a4ac-074fd67b25da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6629d115-2e33-4f4d-a4ac-074fd67b25da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '624727402c1af534151c30511cd72e5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f2da0934a344019ad8e16500be0a69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91f5f6c06956b8ebe1548d9b7d3751252ba778987fa6bd1330550b1d82e33f372c1eba2d62eb929302ea78ebd1c213623a404d4a1e830b2111aa84a0e4dff2c4', 'id': '6629d115-2e33-4f4d-a4ac-074fd67b25da', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6629d115-2e33-4f4d-a4ac-074fd67b25da/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea3e30>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4680290e-58f8-4f28-b0cb-c9eb6df98fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4680290e-58f8-4f28-b0cb-c9eb6df98fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155845cb-2714-4219-bf10-c48c7476a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Volume 26b5f81d-88dd-4570-93e8-21f68b44bb0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d', 'volume_size': 1, 'image_id': '6629d115-2e33-4f4d-a4ac-074fd67b25da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6629d115-2e33-4f4d-a4ac-074fd67b25da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '624727402c1af534151c30511cd72e5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f2da0934a344019ad8e16500be0a69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91f5f6c06956b8ebe1548d9b7d3751252ba778987fa6bd1330550b1d82e33f372c1eba2d62eb929302ea78ebd1c213623a404d4a1e830b2111aa84a0e4dff2c4', 'id': '6629d115-2e33-4f4d-a4ac-074fd67b25da', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6629d115-2e33-4f4d-a4ac-074fd67b25da/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea3e30>}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Trying to clone 26b5f81d-88dd-4570-93e8-21f68b44bb0d from image 6629d115-2e33-4f4d-a4ac-074fd67b25da at location (None, [{'url': 'file:///opt/stack/data/glance/images/6629d115-2e33-4f4d-a4ac-074fd67b25da', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:02:44 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daca2f6-f40a-4089-b3bc-44b90b9c7e95]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:44 devstack sudo[99634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD
Nov 05 12:02:44 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:44 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:45 devstack sudo[99638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD
Nov 05 12:02:45 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:45 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:45 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Created reservations ['14dc1aa0-329c-4a50-a9d6-70fff3d1451c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:45 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD" returned: 1 in 0.727s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Temporary image 6629d115-2e33-4f4d-a4ac-074fd67b25da is fetched for user e6ce8e24fdf84dea96d7b15ded806c28. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:02:45 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:45 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:45 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[986cb6dc-8401-4a51-946f-c790bf3fdc81]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:45 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD
Nov 05 12:02:45 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:46 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-827f5be8-7fc1-47c9-a674-16961b7d51ba tempest-GroupsTest-1984115045 None] Delete group completed successfully.
Nov 05 12:02:46 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:46 devstack sudo[99653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD
Nov 05 12:02:46 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:46 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD" returned: 1 in 0.493s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b5f81d-88dd-4570-93e8-21f68b44bb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f2da0934a344019ad8e16500be0a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:44Z,use_quota=True,user_id='e6ce8e24fdf84dea96d7b15ded806c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Creating volume 26b5f81d-88dd-4570-93e8-21f68b44bb0d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:46 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:46 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d 1073741824
Nov 05 12:02:46 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-977da5b8-4767-45f9-bd53-9c7ef971fe71 tempest-GroupsTest-1984115045 None] Group tempest-GroupsTest-Group-133194603: creating
Nov 05 12:02:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-977da5b8-4767-45f9-bd53-9c7ef971fe71 tempest-GroupsTest-1984115045 None] Group tempest-GroupsTest-Group-133194603: created successfully
Nov 05 12:02:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-977da5b8-4767-45f9-bd53-9c7ef971fe71 tempest-GroupsTest-1984115045 None] Create group completed successfully.
Nov 05 12:02:47 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d 1073741824" returned: 0 in 0.606s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:47 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d
Nov 05 12:02:47 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:47 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Attempting download of 6629d115-2e33-4f4d-a4ac-074fd67b25da ((None, [{'url': 'file:///opt/stack/data/glance/images/6629d115-2e33-4f4d-a4ac-074fd67b25da', 'metadata': {}}])) to volume 26b5f81d-88dd-4570-93e8-21f68b44bb0d. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0ec5a-7a78-41e5-b530-86c0af08f66b]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6629d115-2e33-4f4d-a4ac-074fd67b25da_1hjrb8u8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:47 devstack sudo[99667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6629d115-2e33-4f4d-a4ac-074fd67b25da_1hjrb8u8
Nov 05 12:02:47 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:48 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6629d115-2e33-4f4d-a4ac-074fd67b25da_1hjrb8u8" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6629d115-2e33-4f4d-a4ac-074fd67b25da_1hjrb8u8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:48 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6629d115-2e33-4f4d-a4ac-074fd67b25da_1hjrb8u8
Nov 05 12:02:48 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:48 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6629d115-2e33-4f4d-a4ac-074fd67b25da_1hjrb8u8" returned: 1 in 0.478s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6629d115-2e33-4f4d-a4ac-074fd67b25da_1hjrb8u8' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6b46e9-47e1-494b-a487-d2cfc2c44ade]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:48 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD
Nov 05 12:02:48 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:49 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:49 devstack sudo[99679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD
Nov 05 12:02:49 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Flow 'volume_create_manager' (bef5f8b7-c6af-4120-bc04-7aefe24b8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbf6b12-4fcd-4200-9a4f-cf834847491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbf6b12-4fcd-4200-9a4f-cf834847491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933530652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb7f1efb-1f43-4180-9c62-6a50cd18b5f7,host='devstack@QuobyteHD#QuobyteHD',id=8c2ebdff-f026-4291-ab2f-b5462dfd9ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5dfa6b6727422186d0db39b7737ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:49Z,use_quota=True,user_id='c0c0d205b41948e99d627db61cbbda7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7),volume_type_id=7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c254b814-0d02-4747-bcb0-e6eff6928290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c254b814-0d02-4747-bcb0-e6eff6928290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4c0c90-03d9-437c-9cbe-30acdab156c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4c0c90-03d9-437c-9cbe-30acdab156c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2ebdff-f026-4291-ab2f-b5462dfd9ccb', 'volume_name': 'volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e9753a-fd5b-4e3d-97ef-e6ac5252dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e9753a-fd5b-4e3d-97ef-e6ac5252dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616ad195-f339-4a0e-b518-dbdce4e50ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Volume 8c2ebdff-f026-4291-ab2f-b5462dfd9ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb', 'volume_size': 1}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cb7f1efb-1f43-4180-9c62-6a50cd18b5f7,created_at=2026-11-05T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933530652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb7f1efb-1f43-4180-9c62-6a50cd18b5f7,host='devstack@QuobyteHD#QuobyteHD',id=8c2ebdff-f026-4291-ab2f-b5462dfd9ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5dfa6b6727422186d0db39b7737ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:49Z,use_quota=True,user_id='c0c0d205b41948e99d627db61cbbda7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7),volume_type_id=7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Creating volume 8c2ebdff-f026-4291-ab2f-b5462dfd9ccb {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:49 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:49 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD" returned: 1 in 0.515s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] 6629d115-2e33-4f4d-a4ac-074fd67b25da was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:02:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:49 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb 1073741824
Nov 05 12:02:49 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:49 devstack sudo[99686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d
Nov 05 12:02:49 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:50 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb 1073741824" returned: 0 in 0.569s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:50 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb
Nov 05 12:02:50 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:50 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d" returned: 0 in 0.635s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6629d115-2e33-4f4d-a4ac-074fd67b25da_2s6lp5z_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:02:50 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:50 devstack sudo[99698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d 1G
Nov 05 12:02:50 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:50 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616ad195-f339-4a0e-b518-dbdce4e50ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f15b333-252c-4ed0-94d6-baab89498a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Volume volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb (8c2ebdff-f026-4291-ab2f-b5462dfd9ccb): created successfully
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f15b333-252c-4ed0-94d6-baab89498a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Flow 'volume_create_manager' (bef5f8b7-c6af-4120-bc04-7aefe24b8e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-666a5649-2f7b-4cb5-8976-64116eb9cc94 tempest-GroupsTest-1984115045 None] Created volume successfully.
Nov 05 12:02:50 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d 1G" returned: 0 in 0.465s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Downloaded image 6629d115-2e33-4f4d-a4ac-074fd67b25da ((None, [{'url': 'file:///opt/stack/data/glance/images/6629d115-2e33-4f4d-a4ac-074fd67b25da', 'metadata': {}}])) to volume 26b5f81d-88dd-4570-93e8-21f68b44bb0d successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Temporary image 6629d115-2e33-4f4d-a4ac-074fd67b25da for user e6ce8e24fdf84dea96d7b15ded806c28 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Marking volume 26b5f81d-88dd-4570-93e8-21f68b44bb0d as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Copying metadata from image 6629d115-2e33-4f4d-a4ac-074fd67b25da to 26b5f81d-88dd-4570-93e8-21f68b44bb0d. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Creating volume glance metadata for volume 26b5f81d-88dd-4570-93e8-21f68b44bb0d backed by image 6629d115-2e33-4f4d-a4ac-074fd67b25da with: {'image_id': '6629d115-2e33-4f4d-a4ac-074fd67b25da', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '624727402c1af534151c30511cd72e5e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155845cb-2714-4219-bf10-c48c7476a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d', 'volume_size': 1, 'image_id': '6629d115-2e33-4f4d-a4ac-074fd67b25da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6629d115-2e33-4f4d-a4ac-074fd67b25da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '624727402c1af534151c30511cd72e5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f2da0934a344019ad8e16500be0a69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91f5f6c06956b8ebe1548d9b7d3751252ba778987fa6bd1330550b1d82e33f372c1eba2d62eb929302ea78ebd1c213623a404d4a1e830b2111aa84a0e4dff2c4', 'id': '6629d115-2e33-4f4d-a4ac-074fd67b25da', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6629d115-2e33-4f4d-a4ac-074fd67b25da/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea3e30>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc0eb79-acc1-45ed-a26e-279795742a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Volume volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d (26b5f81d-88dd-4570-93e8-21f68b44bb0d): created successfully
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc0eb79-acc1-45ed-a26e-279795742a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Flow 'volume_create_manager' (a9db0ede-027f-4cdf-a9e6-657afc780b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-64ee69cd-e6b0-4848-8895-2a12037ee9d5 tempest-VolumeImageDependencyTests-154640174 None] Created volume successfully.
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Acquiring lock "cinder-26b5f81d-88dd-4570-93e8-21f68b44bb0d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Lock "cinder-26b5f81d-88dd-4570-93e8-21f68b44bb0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Flow 'volume_create_manager' (93fd58fd-dbfb-46ca-87e1-d4458d8006eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4366e4-32c3-44f4-9974-0d780beb111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4366e4-32c3-44f4-9974-0d780beb111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1907102904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca545c6cca24d4e801793bb2f23f90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:51Z,use_quota=True,user_id='65f755d6a47044f1a01f2fff7715a23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c4a8b8-2e95-484f-a2ea-b999788d81c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c4a8b8-2e95-484f-a2ea-b999788d81c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625b527a-b086-4742-a3c7-3eb7439d0554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Acquiring lock "cinder-quobyte-26b5f81d-88dd-4570-93e8-21f68b44bb0d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Lock "cinder-quobyte-26b5f81d-88dd-4570-93e8-21f68b44bb0d" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4feadc1-7d9a-4efd-96a7-7c8ff2574d01]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:51 devstack sudo[99704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d
Nov 05 12:02:51 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:51 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625b527a-b086-4742-a3c7-3eb7439d0554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4', 'volume_name': 'volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104540fac90>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e72801-a2c5-480e-b740-421dfe6f7ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e72801-a2c5-480e-b740-421dfe6f7ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f18d57b-76b2-4ff9-8f92-6715be6586ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Volume 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104540fac90>}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Trying to clone 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d" returned: 0 in 0.454s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:51 devstack sudo[99710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d
Nov 05 12:02:51 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:52 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-26b5f81d-88dd-4570-93e8-21f68b44bb0d" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Lock "cinder-quobyte-26b5f81d-88dd-4570-93e8-21f68b44bb0d" released by "delete_volume" :: held 0.956s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:02:52 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b966e2a5-4d7d-48aa-88df-569f557f903e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:52 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD
Nov 05 12:02:52 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Created reservations ['1483a8de-0647-43ef-95eb-df24a2e27384', 'ca2b9926-9a9f-4755-be97-73b55ff0d1c0', 'daec90e4-2ad0-4635-bf8a-bed07c78d402', '2fd626ef-b72e-41ac-ab3f-a74edc18ecca'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:52 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:02:52 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:53 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 is fetched for user 65f755d6a47044f1a01f2fff7715a23e. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:53 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Flow 'volume_create_manager' (e7ef9ba8-1d43-4067-a6dc-f1dbbb69c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032ff0e-dc81-40d9-b230-ef00e3f2cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.338s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Deleted volume successfully.
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032ff0e-dc81-40d9-b230-ef00e3f2cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88345501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb7f1efb-1f43-4180-9c62-6a50cd18b5f7,host='devstack@QuobyteHD#QuobyteHD',id=debf772d-d265-4930-a2d1-dfda111071ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5dfa6b6727422186d0db39b7737ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:53Z,use_quota=True,user_id='c0c0d205b41948e99d627db61cbbda7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7),volume_type_id=7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ec8362-ad3b-4593-969b-e06805fd97d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ec8362-ad3b-4593-969b-e06805fd97d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c325160d-653b-4d9e-86e6-54ceae984447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c325160d-653b-4d9e-86e6-54ceae984447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'debf772d-d265-4930-a2d1-dfda111071ab', 'volume_name': 'volume-debf772d-d265-4930-a2d1-dfda111071ab', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9132a5db-cfba-4e60-b134-8e72105e63f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9132a5db-cfba-4e60-b134-8e72105e63f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446ffa37-339b-45d7-adba-7d532d6ab9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Volume debf772d-d265-4930-a2d1-dfda111071ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-debf772d-d265-4930-a2d1-dfda111071ab', 'volume_size': 1}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cb7f1efb-1f43-4180-9c62-6a50cd18b5f7,created_at=2026-11-05T11:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88345501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb7f1efb-1f43-4180-9c62-6a50cd18b5f7,host='devstack@QuobyteHD#QuobyteHD',id=debf772d-d265-4930-a2d1-dfda111071ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5dfa6b6727422186d0db39b7737ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:53Z,use_quota=True,user_id='c0c0d205b41948e99d627db61cbbda7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7),volume_type_id=7bb6ce11-dc02-46eb-ba77-cdf3ab2bedd7)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Creating volume debf772d-d265-4930-a2d1-dfda111071ab {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:53 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:53 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab 1073741824
Nov 05 12:02:53 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374dab9-bdbd-4232-976e-d8c50939775a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d725056a-80ff-4e12-b90f-a2e7e1b89740 tempest-VolumeImageDependencyTests-154640174 None] Lock "cinder-26b5f81d-88dd-4570-93e8-21f68b44bb0d-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:53 devstack sudo[99725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD
Nov 05 12:02:53 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:53 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:53 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab 1073741824" returned: 0 in 0.629s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:54 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab
Nov 05 12:02:54 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:54 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1907102904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca545c6cca24d4e801793bb2f23f90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:51Z,use_quota=True,user_id='65f755d6a47044f1a01f2fff7715a23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Creating volume 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446ffa37-339b-45d7-adba-7d532d6ab9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-debf772d-d265-4930-a2d1-dfda111071ab', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4643f7-ce6b-4e55-b682-7b0dbdbc1802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:54 devstack sudo[99738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 1073741824
Nov 05 12:02:54 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Volume volume-debf772d-d265-4930-a2d1-dfda111071ab (debf772d-d265-4930-a2d1-dfda111071ab): created successfully
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4643f7-ce6b-4e55-b682-7b0dbdbc1802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Flow 'volume_create_manager' (e7ef9ba8-1d43-4067-a6dc-f1dbbb69c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-32127b6e-3707-4181-93b8-de4da597a0ea tempest-GroupsTest-1984115045 None] Created volume successfully.
Nov 05 12:02:54 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 1073741824" returned: 0 in 0.609s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:55 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4
Nov 05 12:02:55 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:55 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Attempting download of 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67016258-2b1a-4bf9-8f03-254e28d0a834]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_1hyyo73e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:55 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_1hyyo73e
Nov 05 12:02:55 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:55 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_1hyyo73e" returned: 0 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_1hyyo73e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1e54785b-cf61-42cd-af92-401f2155cd01 tempest-GroupsTest-1984115045 None] Update group completed successfully.
Nov 05 12:02:55 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_1hyyo73e
Nov 05 12:02:55 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:56 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_1hyyo73e" returned: 1 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_1hyyo73e' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeb6e65-5535-4d79-b818-73878d980d39]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:56 devstack sudo[99755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD
Nov 05 12:02:56 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:56 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:56 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] 97690ee3-6eec-4469-b729-e1fcbb2cb426 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:02:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:56 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4
Nov 05 12:02:56 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-eb12e092-4dfe-4abf-b6e0-3dae7557370a tempest-GroupsTest-1984115045 None] Update group completed successfully.
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Flow 'volume_create_manager' (b993df07-e69a-437f-a084-6654f38365ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e218b72-0d4e-4a74-8b28-767f4d2bf842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e218b72-0d4e-4a74-8b28-767f4d2bf842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f48685-7339-4a93-a415-04b9005c2f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004428f774e0412e9be2c1ec66cd51f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:58Z,use_quota=True,user_id='ee9aada0324d4eb18100f02816e7f56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f40491-490c-40ea-a7ee-36da28e57d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f40491-490c-40ea-a7ee-36da28e57d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4d84d7-5faa-4d68-856a-6ded412587a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4d84d7-5faa-4d68-856a-6ded412587a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f48685-7339-4a93-a415-04b9005c2f29', 'volume_name': 'volume-e3f48685-7339-4a93-a415-04b9005c2f29', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ede107-a22a-4f48-847b-94a69320e914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ede107-a22a-4f48-847b-94a69320e914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19e644f-8822-49fe-a561-c7982a41c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Volume e3f48685-7339-4a93-a415-04b9005c2f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f48685-7339-4a93-a415-04b9005c2f29', 'volume_size': 1}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f48685-7339-4a93-a415-04b9005c2f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004428f774e0412e9be2c1ec66cd51f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:58Z,use_quota=True,user_id='ee9aada0324d4eb18100f02816e7f56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Creating volume e3f48685-7339-4a93-a415-04b9005c2f29 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:02:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:58 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29 1073741824
Nov 05 12:02:58 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:58 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29 1073741824" returned: 0 in 0.789s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:59 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29
Nov 05 12:02:59 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:59 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4" returned: 0 in 2.557s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_av3u7o3jdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:02:59 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Converted 112.00 MB image at 43.78 MB/s
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:59 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 1G
Nov 05 12:02:59 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Acquiring lock "cinder-quobyte-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:59 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Lock "cinder-quobyte-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19e644f-8822-49fe-a561-c7982a41c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f48685-7339-4a93-a415-04b9005c2f29', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89552d4-46c1-4e60-a555-56b33be5f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c2628f-0bee-48c5-8fd8-9673ffdf8ca4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Volume volume-e3f48685-7339-4a93-a415-04b9005c2f29 (e3f48685-7339-4a93-a415-04b9005c2f29): created successfully
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89552d4-46c1-4e60-a555-56b33be5f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Flow 'volume_create_manager' (b993df07-e69a-437f-a084-6654f38365ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-70ae8e82-0de7-4f4e-a8ce-c4d73f68aa26 tempest-CinderUnicodeTest-149226410 None] Created volume successfully.
Nov 05 12:02:59 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb
Nov 05 12:02:59 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:59 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 1G" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Downloaded image 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 for user 65f755d6a47044f1a01f2fff7715a23e is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Marking volume 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Copying metadata from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 to 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Creating volume glance metadata for volume 3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 backed by image 97690ee3-6eec-4469-b729-e1fcbb2cb426 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f18d57b-76b2-4ff9-8f92-6715be6586ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7104540fac90>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005b6c14-5225-468c-93d0-f50e27d41e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Volume volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 (3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4): created successfully
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005b6c14-5225-468c-93d0-f50e27d41e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Flow 'volume_create_manager' (93fd58fd-dbfb-46ca-87e1-d4458d8006eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6a93c45d-e819-451c-93de-2883055d0d7c tempest-TestShelveInstance-1369245379 None] Created volume successfully.
Nov 05 12:02:59 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:59 devstack sudo[99830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb
Nov 05 12:02:59 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:00 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Lock "cinder-quobyte-8c2ebdff-f026-4291-ab2f-b5462dfd9ccb" released by "delete_volume" :: held 0.808s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Acquiring lock "cinder-quobyte-debf772d-d265-4930-a2d1-dfda111071ab" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Lock "cinder-quobyte-debf772d-d265-4930-a2d1-dfda111071ab" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[de02a26f-1707-4dd5-be9e-0cc8ce131573]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:00 devstack sudo[99833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab
Nov 05 12:03:00 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:00 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab" returned: 0 in 0.617s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:00 devstack sudo[99839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab
Nov 05 12:03:00 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Flow 'volume_create_manager' (753fafbf-bf8c-405a-b5f6-f3ce15ccab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f27f17-25e5-422e-bf7a-1c7d7d14b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f27f17-25e5-422e-bf7a-1c7d7d14b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-958187646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa21e6fb-c13a-46d0-9791-a7f99a1c217b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004428f774e0412e9be2c1ec66cd51f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:01Z,use_quota=True,user_id='ee9aada0324d4eb18100f02816e7f56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9df541-2fbb-4a51-9a75-2824f8670745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9df541-2fbb-4a51-9a75-2824f8670745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19b3fb6-afb8-4a98-a906-9d4e8faad2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19b3fb6-afb8-4a98-a906-9d4e8faad2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa21e6fb-c13a-46d0-9791-a7f99a1c217b', 'volume_name': 'volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b50bc0e-07b1-4a98-93c2-634cd26916a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b50bc0e-07b1-4a98-93c2-634cd26916a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042625bb-976a-485a-94d2-c6cce1a01282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Volume fa21e6fb-c13a-46d0-9791-a7f99a1c217b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b', 'volume_size': 1}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-958187646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa21e6fb-c13a-46d0-9791-a7f99a1c217b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004428f774e0412e9be2c1ec66cd51f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:01Z,use_quota=True,user_id='ee9aada0324d4eb18100f02816e7f56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Creating volume fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:01 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:01 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b 1073741824
Nov 05 12:03:01 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:01 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-debf772d-d265-4930-a2d1-dfda111071ab" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Lock "cinder-quobyte-debf772d-d265-4930-a2d1-dfda111071ab" released by "delete_volume" :: held 1.049s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Created reservations ['9de2d367-484a-432b-bcd7-546770220e15'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:01 devstack cinder-volume[87184]: WARNING cinder.quota [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1281361854 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1281361854, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:03:01 devstack cinder-volume[87184]: WARNING cinder.quota [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1281361854 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1281361854, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Created reservations ['d9f8d05f-124e-48c0-b7a3-14fe1eb526ea', '05ae273b-37e0-4306-badc-df12f90ac304', '842492e7-f8f0-4891-b5ef-373402633116', '231f6a36-fda9-433b-b130-0bd3bd2ca840'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Created reservations ['bb46203d-54e6-4800-b3a7-75e072710321', 'ba854bca-0316-443a-837e-21a9f5a533e4', 'deffd1d6-7c5f-431d-b2b1-fddbaa0c5890', '7952c70f-c5f0-49a5-b0c6-d79a9e8759cb'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:01 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b 1073741824" returned: 0 in 0.792s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:01 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b
Nov 05 12:03:01 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:02 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:02 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:02 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" returned: 0 in 0.342s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042625bb-976a-485a-94d2-c6cce1a01282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967f9bcf-fb1a-4912-96f2-da8fbce7abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Volume volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b (fa21e6fb-c13a-46d0-9791-a7f99a1c217b): created successfully
Nov 05 12:03:02 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967f9bcf-fb1a-4912-96f2-da8fbce7abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Flow 'volume_create_manager' (753fafbf-bf8c-405a-b5f6-f3ce15ccab74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-61d67bdf-7978-41b8-ad07-7d29cd09617f tempest-GroupsTest-1984115045 None] Delete group completed successfully.
Nov 05 12:03:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-82fb687c-5aea-4dcf-8221-f4d6935239ab tempest-CinderUnicodeTest-149226410 None] Created volume successfully.
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Creating offline snapshot 85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 of volume fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Flow 'volume_create_manager' (2de754e4-1ff5-4fc4-8696-f5651c772e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed44cceb-1acd-47ec-bab9-8064a0650248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1741e99-8f86-4a74-8b0d-6e4451344053]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-06dcf767-0ecf-4a8f-ac32-3b5fed6384d3 req-21d91dee-7cfd-4d99-bb31-1f6daa942fae tempest-TestShelveInstance-1369245379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed44cceb-1acd-47ec-bab9-8064a0650248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1082393469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c050a2d-f75d-4382-a3de-88d875f3210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb5b48c19d5420eb632e70721ce5e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:04Z,use_quota=True,user_id='18a8966fb3854ca7893c0ba440c467bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e49ccdd-2021-4754-8a12-d9ef45e4e90a),volume_type_id=5e49ccdd-2021-4754-8a12-d9ef45e4e90a)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3df16a5-bfba-4378-8e14-2d626e40ff68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3df16a5-bfba-4378-8e14-2d626e40ff68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaa27a4-c219-4387-ba50-1022fe60bee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaa27a4-c219-4387-ba50-1022fe60bee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c050a2d-f75d-4382-a3de-88d875f3210d', 'volume_name': 'volume-5c050a2d-f75d-4382-a3de-88d875f3210d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44820207-29da-4061-887c-f2d649dcfac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44820207-29da-4061-887c-f2d649dcfac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79536f1-eba8-40f3-907b-c422d4f61ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Volume 5c050a2d-f75d-4382-a3de-88d875f3210d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c050a2d-f75d-4382-a3de-88d875f3210d', 'volume_size': 1}
Nov 05 12:03:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:03 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b
Nov 05 12:03:03 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:04 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" returned: 0 in 0.459s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:04 devstack sudo[99871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 1G
Nov 05 12:03:04 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:04 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 1G" returned: 0 in 0.643s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:04 devstack sudo[99877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25
Nov 05 12:03:04 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:05 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:05 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 is being set with open permissions: ugo+rw
Nov 05 12:03:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:05 devstack sudo[99886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25
Nov 05 12:03:05 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:05 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:05 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.info
Nov 05 12:03:05 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:05 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.info" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:05 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.info is being set with open permissions: ugo+rw
Nov 05 12:03:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:06 devstack sudo[99893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.info
Nov 05 12:03:06 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:06 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.info" returned: 0 in 0.314s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-06dcf767-0ecf-4a8f-ac32-3b5fed6384d3 req-21d91dee-7cfd-4d99-bb31-1f6daa942fae tempest-TestShelveInstance-1369245379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.553s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-06dcf767-0ecf-4a8f-ac32-3b5fed6384d3 req-21d91dee-7cfd-4d99-bb31-1f6daa942fae tempest-TestShelveInstance-1369245379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1082393469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c050a2d-f75d-4382-a3de-88d875f3210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb5b48c19d5420eb632e70721ce5e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:04Z,use_quota=True,user_id='18a8966fb3854ca7893c0ba440c467bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e49ccdd-2021-4754-8a12-d9ef45e4e90a),volume_type_id=5e49ccdd-2021-4754-8a12-d9ef45e4e90a)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Creating volume 5c050a2d-f75d-4382-a3de-88d875f3210d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:06 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:06 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d 1073741824
Nov 05 12:03:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4b85d464-bf37-49c7-bb8e-8f14238d04a1 tempest-CinderUnicodeTest-149226410 None] Create snapshot completed successfully
Nov 05 12:03:06 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-06dcf767-0ecf-4a8f-ac32-3b5fed6384d3 req-21d91dee-7cfd-4d99-bb31-1f6daa942fae tempest-TestShelveInstance-1369245379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c858da0d-1bf7-422c-8ed7-8530ee3f6c1d', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:03:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-06dcf767-0ecf-4a8f-ac32-3b5fed6384d3 req-21d91dee-7cfd-4d99-bb31-1f6daa942fae tempest-TestShelveInstance-1369245379 None] attachment_update completed successfully.
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Acquiring lock "cinder-85fbefb3-31e7-4fd2-b43a-1e2e03b04b25-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Lock "cinder-85fbefb3-31e7-4fd2-b43a-1e2e03b04b25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Acquiring lock "cinder-quobyte-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Acquiring lock "cinder-quobyte-85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Deleting offline snapshot 85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 of volume fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] snapshot_file for this snap is: volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ff89e9-52a4-4f53-bb90-575756b8dcaf]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:07 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25
Nov 05 12:03:07 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:07 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d 1073741824" returned: 0 in 0.816s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:07 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d
Nov 05 12:03:07 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:07 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d" returned: 0 in 0.587s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:07 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" returned: 0 in 0.896s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79536f1-eba8-40f3-907b-c422d4f61ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c050a2d-f75d-4382-a3de-88d875f3210d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f1aba8-4754-4c76-ad5f-4c5540920922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8fc8ac-8c1a-4a8a-ba6c-751ec825beba]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Volume volume-5c050a2d-f75d-4382-a3de-88d875f3210d (5c050a2d-f75d-4382-a3de-88d875f3210d): created successfully
Nov 05 12:03:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f1aba8-4754-4c76-ad5f-4c5540920922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Flow 'volume_create_manager' (2de754e4-1ff5-4fc4-8696-f5651c772e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2cd3e176-877c-4ef0-adc5-662698059122 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Created volume successfully.
Nov 05 12:03:08 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b
Nov 05 12:03:08 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:08 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" returned: 0 in 0.695s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:08 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25
Nov 05 12:03:08 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:09 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" returned: 0 in 0.602s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:09 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25
Nov 05 12:03:09 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:09 devstack sudo[100405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:09 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:09 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b.85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" returned: 0 in 0.360s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-85fbefb3-31e7-4fd2-b43a-1e2e03b04b25" released by "_delete_snapshot" :: held 2.835s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" released by "delete_snapshot" :: held 2.885s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Created reservations ['1bcc65f6-8abb-43d8-b5b9-b5176734e691', '10f75823-f551-4662-b709-29e6663e59d8', '1bbc604e-0d85-4d30-9037-9babeb31a8c1', 'd984f623-196d-48d2-84a5-7812c180e556'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:10 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Delete snapshot completed successfully.
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.467s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5794ccbe-b778-4fed-a6f4-ecb417b5898d tempest-CinderUnicodeTest-149226410 None] Lock "cinder-85fbefb3-31e7-4fd2-b43a-1e2e03b04b25-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6927576-040c-4308-9c91-a71a2fec047f tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Retype volume completed successfully.
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Acquiring lock "cinder-fa21e6fb-c13a-46d0-9791-a7f99a1c217b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-fa21e6fb-c13a-46d0-9791-a7f99a1c217b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Acquiring lock "cinder-quobyte-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f57f32-7843-4dd0-a4ff-97bbc32b90bd]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:10 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b
Nov 05 12:03:10 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:11 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" returned: 0 in 0.613s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:11 devstack sudo[100415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b
Nov 05 12:03:11 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:11 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-fa21e6fb-c13a-46d0-9791-a7f99a1c217b" released by "delete_volume" :: held 1.243s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Created reservations ['d5c6fc8d-ffb6-4b6f-a82f-c527297313c3', '832fe39a-920b-420d-b49e-4c90f3592db4', '08ec43a7-445a-4071-9cdc-23a5d3e3f6bf', 'c6a24fb7-7ae4-4084-9a3e-d6e59b0651e3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Acquiring lock "cinder-5c050a2d-f75d-4382-a3de-88d875f3210d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "cinder-5c050a2d-f75d-4382-a3de-88d875f3210d-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:11 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:11 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Acquiring lock "cinder-quobyte-5c050a2d-f75d-4382-a3de-88d875f3210d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "cinder-quobyte-5c050a2d-f75d-4382-a3de-88d875f3210d" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3f8810-7188-47ac-8e16-6ff796e5c6d7]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:12 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Deleted volume successfully.
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d3fdd2-01cd-4bcc-af42-a068aed5a42e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-fa21e6fb-c13a-46d0-9791-a7f99a1c217b-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:12 devstack sudo[100420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d
Nov 05 12:03:12 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Acquiring lock "cinder-e3f48685-7339-4a93-a415-04b9005c2f29-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-e3f48685-7339-4a93-a415-04b9005c2f29-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Acquiring lock "cinder-quobyte-e3f48685-7339-4a93-a415-04b9005c2f29" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-e3f48685-7339-4a93-a415-04b9005c2f29" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e0705-ac40-41a7-bbe2-2774acfdf9c9]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:12 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d" returned: 0 in 0.791s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:12 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d
Nov 05 12:03:12 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:13 devstack sudo[100427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29
Nov 05 12:03:13 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:13 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5c050a2d-f75d-4382-a3de-88d875f3210d" returned: 0 in 0.555s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "cinder-quobyte-5c050a2d-f75d-4382-a3de-88d875f3210d" released by "delete_volume" :: held 1.466s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:13 devstack cinder-volume[87184]: WARNING cinder.quota [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:03:13 devstack cinder-volume[87184]: WARNING cinder.quota [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Flow 'volume_create_manager' (8035df3b-ea6d-41e0-958c-f9166f86993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b84573-c477-4c63-9da6-4e568c4f5e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b84573-c477-4c63-9da6-4e568c4f5e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-477162655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9315b39c-402c-4a73-bd48-0369a4d3ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1380b7d9da204a10a1f94c3f1cf8c0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:14Z,use_quota=True,user_id='b25c8a37e82e4363a724f333173a6cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a429a6-1b02-44be-bdbe-82af29cc70c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a429a6-1b02-44be-bdbe-82af29cc70c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5929d124-4580-4cbf-9d04-5affc025d339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5929d124-4580-4cbf-9d04-5affc025d339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9315b39c-402c-4a73-bd48-0369a4d3ef41', 'volume_name': 'volume-9315b39c-402c-4a73-bd48-0369a4d3ef41', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:13 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72afb1cc-99a8-443a-9dff-2169cdca4634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72afb1cc-99a8-443a-9dff-2169cdca4634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2104739d-e375-46bd-8177-bed67bd1621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Volume 9315b39c-402c-4a73-bd48-0369a4d3ef41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9315b39c-402c-4a73-bd48-0369a4d3ef41', 'volume_size': 1}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-477162655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9315b39c-402c-4a73-bd48-0369a4d3ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1380b7d9da204a10a1f94c3f1cf8c0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:14Z,use_quota=True,user_id='b25c8a37e82e4363a724f333173a6cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Creating volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29" returned: 0 in 1.004s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Created reservations ['b50c87f5-072f-46aa-ade6-2359cfe31f59', '55b5cc8a-7fa4-4bae-bcb2-71cb6c0344e2', '01da5141-e132-4334-bba0-7633629a809c', '8f118a0f-cec2-4359-aa29-c2a0573c0a4a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:13 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 1073741824
Nov 05 12:03:13 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:13 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29
Nov 05 12:03:13 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:14 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:14 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:14 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e3f48685-7339-4a93-a415-04b9005c2f29" returned: 0 in 0.570s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-quobyte-e3f48685-7339-4a93-a415-04b9005c2f29" released by "delete_volume" :: held 1.660s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:14 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.587s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Deleted volume successfully.
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Created reservations ['8046d99e-8f1a-482d-a4f4-6b8125186187', 'b2ef80dc-53ca-44b7-a10d-f1d89ae099f0', 'ead9d789-a3cd-4204-9331-595c00275df5', '71da12ad-5c66-4ee5-9466-bb6dc03f4c8b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd71895c-ded0-44e5-ad65-314bce479381 tempest-VolumeRetypeWithoutMigrationTest-1312705083 None] Lock "cinder-5c050a2d-f75d-4382-a3de-88d875f3210d-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:14 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 1073741824" returned: 0 in 1.046s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:14 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:14 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:15 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41
Nov 05 12:03:15 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:15 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.666s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Deleted volume successfully.
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be76b80e-a507-4d92-8263-ac38a257c44e tempest-CinderUnicodeTest-149226410 None] Lock "cinder-e3f48685-7339-4a93-a415-04b9005c2f29-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:15 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41" returned: 0 in 0.821s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2104739d-e375-46bd-8177-bed67bd1621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9315b39c-402c-4a73-bd48-0369a4d3ef41', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b70473-6195-4d83-96a2-d3990644999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Volume volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 (9315b39c-402c-4a73-bd48-0369a4d3ef41): created successfully
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b70473-6195-4d83-96a2-d3990644999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Flow 'volume_create_manager' (8035df3b-ea6d-41e0-958c-f9166f86993b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0d605d33-5fed-4164-ac5c-854171138921 tempest-SnapshotsActionsTest-655492339 None] Created volume successfully.
Nov 05 12:03:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Creating offline snapshot 59fbe580-d611-43c9-ad3c-0ca336bd6e50 of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:03:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9900a226-01f8-414b-acb2-3574a3345956]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:17 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41
Nov 05 12:03:17 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:17 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41" returned: 0 in 0.623s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:17 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 1G
Nov 05 12:03:17 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:18 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 1G" returned: 0 in 0.575s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:18 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:18 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:18 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.374s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:18 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 is being set with open permissions: ugo+rw
Nov 05 12:03:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:18 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:18 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:19 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:19 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.info
Nov 05 12:03:19 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:19 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.info" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:19 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.info is being set with open permissions: ugo+rw
Nov 05 12:03:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:19 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.info
Nov 05 12:03:19 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:19 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.info" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-16eeb342-2f81-4b88-a605-58f252e9b89c tempest-SnapshotsActionsTest-655492339 None] Create snapshot completed successfully
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Creating offline snapshot 4ae4f3f3-7d8f-4014-b329-1ff16c051d3c of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e457b162-dd26-4d28-9a04-cd85002369e5]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:21 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:21 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:21 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.549s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:21 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c 1G
Nov 05 12:03:21 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:22 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c 1G" returned: 0 in 0.648s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:22 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c
Nov 05 12:03:22 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:22 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:22 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c is being set with open permissions: ugo+rw
Nov 05 12:03:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:22 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c
Nov 05 12:03:22 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:23 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" returned: 0 in 0.330s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9bb9904f-0f89-4bb1-87d5-01c6dec434ba tempest-SnapshotsActionsTest-655492339 None] Create snapshot completed successfully
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-4ae4f3f3-7d8f-4014-b329-1ff16c051d3c-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-4ae4f3f3-7d8f-4014-b329-1ff16c051d3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Deleting offline snapshot 4ae4f3f3-7d8f-4014-b329-1ff16c051d3c of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] snapshot_file for this snap is: volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c469b3bc-4fcf-4170-b600-adae12fa4788]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:25 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c
Nov 05 12:03:25 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:25 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" returned: 0 in 0.519s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2464e19-82b5-47e8-a33e-b331d1686e99]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:25 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:25 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:26 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.576s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:26 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c
Nov 05 12:03:26 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:26 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:26 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c
Nov 05 12:03:26 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:26 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-4ae4f3f3-7d8f-4014-b329-1ff16c051d3c" released by "_delete_snapshot" :: held 2.137s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" released by "delete_snapshot" :: held 2.181s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=139,cinder:INSERT=41,cinder:UPDATE=149,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Created reservations ['01e843de-32d8-4dd4-bb59-c2bd68ac5740', '19520ba0-b702-4469-9eca-6ce02e0f7b48', '83881ee5-b31f-40a4-b33a-534f536d8767', '49f9c8ca-7c4e-4ef5-9441-9cdf54b7aae2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Delete snapshot completed successfully.
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67872b0e-cbaa-477d-b316-8eaab6cb27aa tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-4ae4f3f3-7d8f-4014-b329-1ff16c051d3c-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (33b57246-d5f4-4582-8dae-439cb1e22d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ff78c6-bf31-4aef-a1a3-9f0215cfd654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ff78c6-bf31-4aef-a1a3-9f0215cfd654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-32593894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab38287-3888-4f02-8fe3-923f1859a4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:28Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376a3508-9c6b-4822-a6d3-fd1a90f3c143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376a3508-9c6b-4822-a6d3-fd1a90f3c143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561ba22a-2473-4a5b-b7a6-4b8868897de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561ba22a-2473-4a5b-b7a6-4b8868897de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab38287-3888-4f02-8fe3-923f1859a4d3', 'volume_name': 'volume-6ab38287-3888-4f02-8fe3-923f1859a4d3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9702667-4ac6-4983-9047-ea82c78eacb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9702667-4ac6-4983-9047-ea82c78eacb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64550a53-6b1a-4832-92c5-7a7becb66ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Volume 6ab38287-3888-4f02-8fe3-923f1859a4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab38287-3888-4f02-8fe3-923f1859a4d3', 'volume_size': 1}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-32593894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab38287-3888-4f02-8fe3-923f1859a4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:28Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Creating volume 6ab38287-3888-4f02-8fe3-923f1859a4d3 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:27 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:27 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3 1073741824
Nov 05 12:03:27 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:28 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3 1073741824" returned: 0 in 0.574s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:28 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3
Nov 05 12:03:28 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:28 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.381s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64550a53-6b1a-4832-92c5-7a7becb66ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab38287-3888-4f02-8fe3-923f1859a4d3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa122f8-c62a-46d5-aca4-570c1238728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Creating offline snapshot 7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:03:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Volume volume-6ab38287-3888-4f02-8fe3-923f1859a4d3 (6ab38287-3888-4f02-8fe3-923f1859a4d3): created successfully
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa122f8-c62a-46d5-aca4-570c1238728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (33b57246-d5f4-4582-8dae-439cb1e22d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45732a-2267-4c7f-a654-873e62b750b0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f18f8909-92fe-4ebc-9980-14051cbbd646 tempest-ProjectReaderTests-864410469 None] Created volume successfully.
Nov 05 12:03:28 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:28 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:29 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:29 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 1G
Nov 05 12:03:29 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:29 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 1G" returned: 0 in 0.520s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:29 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5
Nov 05 12:03:29 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:30 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" returned: 0 in 0.338s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:30 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 is being set with open permissions: ugo+rw
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:30 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5
Nov 05 12:03:30 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-6ab38287-3888-4f02-8fe3-923f1859a4d3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Lock "cinder-6ab38287-3888-4f02-8fe3-923f1859a4d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-quobyte-6ab38287-3888-4f02-8fe3-923f1859a4d3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-6ab38287-3888-4f02-8fe3-923f1859a4d3" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6966b983-a15c-45d7-8675-f77133ff369e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:30 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" returned: 0 in 0.316s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.696s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:30 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3
Nov 05 12:03:30 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e71af66a-b8d8-4ed3-a411-06e31d0467e3 tempest-SnapshotsActionsTest-655492339 None] Create snapshot completed successfully
Nov 05 12:03:30 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3" returned: 0 in 0.407s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:30 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3
Nov 05 12:03:30 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:31 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6ab38287-3888-4f02-8fe3-923f1859a4d3" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-6ab38287-3888-4f02-8fe3-923f1859a4d3" released by "delete_volume" :: held 0.715s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Created reservations ['5e28ccd9-2eb5-4ddf-99b2-2f010722bd2a', '461f7f74-485b-46c3-8051-541f0715f2e2', 'e1eb1194-687b-4aec-8a33-b3091b278a84', 'f4d3032b-89ee-4776-b586-4f8d033970d1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:31 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:31 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:31 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Deleted volume successfully.
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc7efb62-9c64-41f9-85c5-6b1fb942952b tempest-ProjectReaderTests-864410469 None] Lock "cinder-6ab38287-3888-4f02-8fe3-923f1859a4d3-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-7a6a7c61-9f90-48e2-a7ec-aadcea1234d5-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-7a6a7c61-9f90-48e2-a7ec-aadcea1234d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Deleting offline snapshot 7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] snapshot_file for this snap is: volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1852fcaa-312b-4375-b381-389e2fead8e7]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:31 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5
Nov 05 12:03:31 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:31 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (24fc57a0-a2a7-4d35-936f-53fd103356b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540beb49-ff17-4ad4-9f3b-1f014e515607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540beb49-ff17-4ad4-9f3b-1f014e515607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856115356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6253021a-a2c2-4da5-9958-1b4f9a245dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:32Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea3183-c3e6-4b1a-b64d-165b04f6ce1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea3183-c3e6-4b1a-b64d-165b04f6ce1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf98983-6b40-4766-a532-bb3fe89f5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf98983-6b40-4766-a532-bb3fe89f5b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6253021a-a2c2-4da5-9958-1b4f9a245dba', 'volume_name': 'volume-6253021a-a2c2-4da5-9958-1b4f9a245dba', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be43c5cf-4ba5-4af1-8105-eabf6515f406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be43c5cf-4ba5-4af1-8105-eabf6515f406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02ec787-2bf8-46b8-8589-7310ee6cb7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Volume 6253021a-a2c2-4da5-9958-1b4f9a245dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6253021a-a2c2-4da5-9958-1b4f9a245dba', 'volume_size': 1}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856115356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6253021a-a2c2-4da5-9958-1b4f9a245dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:32Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Creating volume 6253021a-a2c2-4da5-9958-1b4f9a245dba {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:32 devstack sudo[100607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba 1073741824
Nov 05 12:03:32 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:32 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef190e5-662e-485f-a450-d3324dfef4c7]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:32 devstack sudo[100612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:32 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:32 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba 1073741824" returned: 0 in 0.591s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:32 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:32 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba
Nov 05 12:03:32 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:32 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5
Nov 05 12:03:32 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:33 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02ec787-2bf8-46b8-8589-7310ee6cb7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6253021a-a2c2-4da5-9958-1b4f9a245dba', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4066cb8c-7fde-4f00-9534-19ffb6724f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Volume volume-6253021a-a2c2-4da5-9958-1b4f9a245dba (6253021a-a2c2-4da5-9958-1b4f9a245dba): created successfully
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4066cb8c-7fde-4f00-9534-19ffb6724f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (24fc57a0-a2a7-4d35-936f-53fd103356b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-82149e29-a687-4d21-bc9b-0048510aa36f tempest-ProjectReaderTests-864410469 None] Created volume successfully.
Nov 05 12:03:33 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" returned: 0 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:33 devstack sudo[100630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5
Nov 05 12:03:33 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:33 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-7a6a7c61-9f90-48e2-a7ec-aadcea1234d5" released by "_delete_snapshot" :: held 1.774s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" released by "delete_snapshot" :: held 1.805s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Created reservations ['39f8a368-9800-4fe5-a22a-0a93029e0f6a', 'c1a4b4f1-8856-4e20-8f9d-0323c82da93d', 'c03bbff3-e9b4-46ec-85a5-d73f1dcb1bfd', '9c5e7838-d469-4596-88bf-2d7490ec5119'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Delete snapshot completed successfully.
Nov 05 12:03:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f835d419-4e13-408c-a956-fe26aecc53db tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-7a6a7c61-9f90-48e2-a7ec-aadcea1234d5-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-6253021a-a2c2-4da5-9958-1b4f9a245dba-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Creating offline snapshot a2e7447e-1c45-48a6-88f5-4517969b312c of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Lock "cinder-6253021a-a2c2-4da5-9958-1b4f9a245dba-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6971d0-1c84-492a-be9b-599b3192930a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-quobyte-6253021a-a2c2-4da5-9958-1b4f9a245dba" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-6253021a-a2c2-4da5-9958-1b4f9a245dba" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b463fa3-bfa2-4a43-b198-84361e50a51f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:34 devstack sudo[100634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:34 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:34 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba
Nov 05 12:03:34 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:34 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:34 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c 1G
Nov 05 12:03:34 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:34 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:34 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba
Nov 05 12:03:34 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:35 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6253021a-a2c2-4da5-9958-1b4f9a245dba" returned: 0 in 0.335s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-6253021a-a2c2-4da5-9958-1b4f9a245dba" released by "delete_volume" :: held 0.833s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Created reservations ['9c76c387-d9fe-4637-8f27-c7a92a89d016', '4a09d641-1788-488f-92bf-8bd54a4ff726', '26b0dbb0-30e6-44f2-9e01-6451fa9e8db2', '9a27709e-d0c8-4685-a2b0-91a3c7751b65'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:35 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:35 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:35 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c 1G" returned: 0 in 0.718s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:35 devstack sudo[100661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c
Nov 05 12:03:35 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:35 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.330s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Deleted volume successfully.
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5afac763-ab17-468f-959e-124490990432 tempest-ProjectReaderTests-864410469 None] Lock "cinder-6253021a-a2c2-4da5-9958-1b4f9a245dba-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:35 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:35 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c is being set with open permissions: ugo+rw
Nov 05 12:03:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:35 devstack sudo[100667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c
Nov 05 12:03:35 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=143,cinder:UPDATE=147,cinder:INSERT=50,cinder:DELETE=14 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (677e98b3-3d39-498f-bf07-745d5766a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:36 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06711e95-dda8-4ba2-8f35-2b1b7ea35589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06711e95-dda8-4ba2-8f35-2b1b7ea35589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172218098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dd4dd6-0df5-4b15-9c68-19fda9fd0baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:36Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293ceded-58ba-4701-ad16-1a9fba3202d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293ceded-58ba-4701-ad16-1a9fba3202d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09306f0-175c-43c4-ba09-98e2ff3b411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09306f0-175c-43c4-ba09-98e2ff3b411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dd4dd6-0df5-4b15-9c68-19fda9fd0baa', 'volume_name': 'volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6f1dde-d07c-4943-ac0a-da01e187067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6f1dde-d07c-4943-ac0a-da01e187067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70138c2f-14b0-4455-a915-51d791197ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Volume 95dd4dd6-0df5-4b15-9c68-19fda9fd0baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa', 'volume_size': 1}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172218098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dd4dd6-0df5-4b15-9c68-19fda9fd0baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:36Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Creating volume 95dd4dd6-0df5-4b15-9c68-19fda9fd0baa {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:36 devstack sudo[100670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa 1073741824
Nov 05 12:03:36 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-be70e8aa-373e-4451-949a-df5c2dfbc07a tempest-SnapshotsActionsTest-655492339 None] Create snapshot completed successfully
Nov 05 12:03:36 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa 1073741824" returned: 0 in 0.463s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:36 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa
Nov 05 12:03:36 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:37 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70138c2f-14b0-4455-a915-51d791197ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f3fa66-5c00-4185-ad92-f10d3465dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Volume volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa (95dd4dd6-0df5-4b15-9c68-19fda9fd0baa): created successfully
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f3fa66-5c00-4185-ad92-f10d3465dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (677e98b3-3d39-498f-bf07-745d5766a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a2a92921-e16d-4c90-9d4f-73808db36a46 tempest-ProjectReaderTests-864410469 None] Created volume successfully.
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-a2e7447e-1c45-48a6-88f5-4517969b312c-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-a2e7447e-1c45-48a6-88f5-4517969b312c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-a2e7447e-1c45-48a6-88f5-4517969b312c" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-a2e7447e-1c45-48a6-88f5-4517969b312c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Deleting offline snapshot a2e7447e-1c45-48a6-88f5-4517969b312c of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] snapshot_file for this snap is: volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c0df31-02e5-4ba1-8e03-8a4e994801d2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:37 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c
Nov 05 12:03:37 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:38 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d926a-e296-4a5f-96ba-057cd2f1fa04]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Flow 'volume_create_manager' (7f6ee3d2-bc30-45c6-998f-34bae8eebcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd8bdc2-b0fb-4929-ae13-a199fb5d4e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd8bdc2-b0fb-4929-ae13-a199fb5d4e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1597551995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32fbc43-ca92-4e7b-9286-8dd5852aec1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3463ad48647cbb6b54b31f75d5e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:38Z,use_quota=True,user_id='fe0749a94a6b47f2b8ed68cf81233f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd50767-eff6-4818-8fa3-3e493c612dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:38 devstack sudo[100689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:38 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd50767-eff6-4818-8fa3-3e493c612dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b8a326-adaa-4629-869b-d61b7d95e4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b8a326-adaa-4629-869b-d61b7d95e4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32fbc43-ca92-4e7b-9286-8dd5852aec1f', 'volume_name': 'volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f32e6d2-7625-4da2-9904-a2aba01180d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f32e6d2-7625-4da2-9904-a2aba01180d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d80a684-f257-4961-8cde-5f6e7298494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Volume f32fbc43-ca92-4e7b-9286-8dd5852aec1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f', 'volume_size': 1}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1597551995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32fbc43-ca92-4e7b-9286-8dd5852aec1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3463ad48647cbb6b54b31f75d5e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:38Z,use_quota=True,user_id='fe0749a94a6b47f2b8ed68cf81233f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Creating volume f32fbc43-ca92-4e7b-9286-8dd5852aec1f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:38 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:38 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f 1073741824
Nov 05 12:03:38 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Lock "cinder-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-quobyte-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d241cb-77a1-40f9-8e4b-8948855ca1d1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:38 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.465s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:38 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c
Nov 05 12:03:38 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:38 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa
Nov 05 12:03:38 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:38 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f 1073741824" returned: 0 in 0.554s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:38 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f
Nov 05 12:03:38 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:38 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa" returned: 0 in 0.477s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:38 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c" returned: 0 in 0.464s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:38 devstack sudo[100721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa
Nov 05 12:03:38 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:39 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c
Nov 05 12:03:39 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:39 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d80a684-f257-4961-8cde-5f6e7298494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97db1eb-820f-4fdc-a494-531d88aef7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Volume volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f (f32fbc43-ca92-4e7b-9286-8dd5852aec1f): created successfully
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97db1eb-820f-4fdc-a494-531d88aef7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Flow 'volume_create_manager' (7f6ee3d2-bc30-45c6-998f-34bae8eebcbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6f4ca79b-72d7-42c0-beba-94f5c4e43165 tempest-VolumesListAdminTestJSON-746449436 None] Created volume successfully.
Nov 05 12:03:39 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.a2e7447e-1c45-48a6-88f5-4517969b312c" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-a2e7447e-1c45-48a6-88f5-4517969b312c" released by "_delete_snapshot" :: held 1.803s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:39 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa" returned: 0 in 0.405s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" released by "delete_snapshot" :: held 1.840s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa" released by "delete_volume" :: held 0.932s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Created reservations ['d30a9f49-6e5d-4488-a9ef-8db0ea74f042', '6c8bbc29-653b-494f-bb0d-854e606f87b6', '26ebb5af-c9ef-46d7-8c0a-de40fd68e0cb', '8b05d05b-c8ca-4f1a-81da-5470226bb9dd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Created reservations ['263c8def-6c77-48cb-a84e-032a33192686', 'c9c94911-5329-460a-bd4d-b5e51ba1064f', 'e94aa37d-986a-4554-b06d-0bc9b5d02641', '9686492e-70cf-4903-b640-bf92a666d9f4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Delete snapshot completed successfully.
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03d31a00-1da5-4f5e-808c-e78403e985d3 tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-a2e7447e-1c45-48a6-88f5-4517969b312c-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:39 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:39 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:39 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Deleted volume successfully.
Nov 05 12:03:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-27ae0702-cad1-4976-b922-1477f386656e tempest-ProjectReaderTests-864410469 None] Lock "cinder-95dd4dd6-0df5-4b15-9c68-19fda9fd0baa-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Creating offline snapshot 0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453c7cd-f22d-4733-9680-10e12d7a27e5]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:40 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:40 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:40 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:40 devstack sudo[100741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 1G
Nov 05 12:03:40 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:40 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Flow 'volume_create_manager' (9adfacd4-9901-4c86-a9ac-493a9f99141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44adba4-432a-472f-bec5-64736dd4f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44adba4-432a-472f-bec5-64736dd4f616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-124261993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcee18d-c42f-4d8c-a0cf-5a5e7b438563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3463ad48647cbb6b54b31f75d5e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:41Z,use_quota=True,user_id='fe0749a94a6b47f2b8ed68cf81233f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca3505b-3c9b-4fd9-ac1d-fbfc75794378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca3505b-3c9b-4fd9-ac1d-fbfc75794378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c143dfc-308c-48eb-88af-3bd03f7e3689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c143dfc-308c-48eb-88af-3bd03f7e3689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bcee18d-c42f-4d8c-a0cf-5a5e7b438563', 'volume_name': 'volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa208a4-9cf2-40d7-bfe6-64a626a29aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa208a4-9cf2-40d7-bfe6-64a626a29aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a46f60-5073-4ebb-a594-6e358b37c79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Volume 3bcee18d-c42f-4d8c-a0cf-5a5e7b438563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563', 'volume_size': 1}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 1G" returned: 0 in 0.690s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:41 devstack sudo[100747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8
Nov 05 12:03:41 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (f15b229e-b6e5-47ac-a33f-73476eb1cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db6d764-b758-4619-9502-72eb07f0a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db6d764-b758-4619-9502-72eb07f0a639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939102838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3e3515-9710-4db0-9e40-fb58d8edf0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:41Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4563281d-40df-4a6e-b7f1-959479291f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4563281d-40df-4a6e-b7f1-959479291f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2363ec5a-b738-498d-843e-1b3ad037d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2363ec5a-b738-498d-843e-1b3ad037d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3e3515-9710-4db0-9e40-fb58d8edf0e1', 'volume_name': 'volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bea99fc-b839-4a87-bba6-4a9605a2fa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bea99fc-b839-4a87-bba6-4a9605a2fa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f99b6a-5459-4d62-86ed-338790185808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Volume 4c3e3515-9710-4db0-9e40-fb58d8edf0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1', 'volume_size': 1}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:41 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 is being set with open permissions: ugo+rw
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:41 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8
Nov 05 12:03:41 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e6e51ac7-8ec0-49f8-acac-4dacf4df0685 req-aaaac0a3-4787-44b1-8aa2-52f10ca7d61e tempest-TestShelveInstance-1369245379 None] Terminate volume connection completed successfully.
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e6e51ac7-8ec0-49f8-acac-4dacf4df0685 req-aaaac0a3-4787-44b1-8aa2-52f10ca7d61e tempest-TestShelveInstance-1369245379 None] Deleting attachment c858da0d-1bf7-422c-8ed7-8530ee3f6c1d. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:03:41 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-124261993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcee18d-c42f-4d8c-a0cf-5a5e7b438563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3463ad48647cbb6b54b31f75d5e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:41Z,use_quota=True,user_id='fe0749a94a6b47f2b8ed68cf81233f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Creating volume 3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:42 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 1073741824
Nov 05 12:03:42 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6a36fd38-7005-49c0-8127-9784d1c9c2a6 tempest-SnapshotsActionsTest-655492339 None] Create snapshot completed successfully
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-0b30bf39-454f-4dcf-81d4-72ef70a5e1d8-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-0b30bf39-454f-4dcf-81d4-72ef70a5e1d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Acquiring lock "cinder-quobyte-0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Deleting offline snapshot 0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] snapshot_file for this snap is: volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d0492-d5ae-4ff1-af68-17bbc720451c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:42 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8
Nov 05 12:03:42 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:42 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 1073741824" returned: 0 in 0.622s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:42 devstack sudo[100787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563
Nov 05 12:03:42 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:42 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[162789ca-8b2b-4bd9-9e16-beda31e28899]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:42 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939102838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3e3515-9710-4db0-9e40-fb58d8edf0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e87a6a63cc4f329440cc5bfb7b2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:41Z,use_quota=True,user_id='c309409845294435976b69e3d51b828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Creating volume 4c3e3515-9710-4db0-9e40-fb58d8edf0e1 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:42 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a46f60-5073-4ebb-a594-6e358b37c79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:42 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1 1073741824
Nov 05 12:03:42 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32495aea-bfd4-454f-977f-0b82818dfdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Volume volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 (3bcee18d-c42f-4d8c-a0cf-5a5e7b438563): created successfully
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32495aea-bfd4-454f-977f-0b82818dfdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Flow 'volume_create_manager' (9adfacd4-9901-4c86-a9ac-493a9f99141e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:42 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:42 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-338701a3-b412-4270-9483-03350f03057a tempest-VolumesListAdminTestJSON-746449436 None] Created volume successfully.
Nov 05 12:03:43 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.428s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:43 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8
Nov 05 12:03:43 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:43 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1 1073741824" returned: 0 in 0.609s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:43 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1
Nov 05 12:03:43 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:43 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" returned: 0 in 0.467s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:43 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8
Nov 05 12:03:43 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:43 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f99b6a-5459-4d62-86ed-338790185808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3bd51f-f973-42f7-8cfd-b28d1e1cf9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Volume volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1 (4c3e3515-9710-4db0-9e40-fb58d8edf0e1): created successfully
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3bd51f-f973-42f7-8cfd-b28d1e1cf9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Flow 'volume_create_manager' (f15b229e-b6e5-47ac-a33f-73476eb1cb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dceb0663-38e2-43a6-8444-e17bc67fa025 tempest-ProjectReaderTests-864410469 None] Created volume successfully.
Nov 05 12:03:44 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-0b30bf39-454f-4dcf-81d4-72ef70a5e1d8" released by "_delete_snapshot" :: held 1.733s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" released by "delete_snapshot" :: held 1.765s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Created reservations ['223240db-7c1d-4025-b8f7-63681598bbe8', '0da08d3b-c3ea-4ffa-9dc6-947f5b6db552', '1bc1119b-f00a-4755-9341-1956a35a2efa', '9395394a-8cd6-4cab-9e8d-a4cc3c7b3820'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Delete snapshot completed successfully.
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b3f8d8dc-4a58-406e-a101-bd1c72b7bbef tempest-SnapshotsActionsTest-1915624275 None] Lock "cinder-0b30bf39-454f-4dcf-81d4-72ef70a5e1d8-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-4c3e3515-9710-4db0-9e40-fb58d8edf0e1-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Lock "cinder-4c3e3515-9710-4db0-9e40-fb58d8edf0e1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Acquiring lock "cinder-quobyte-4c3e3515-9710-4db0-9e40-fb58d8edf0e1" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-4c3e3515-9710-4db0-9e40-fb58d8edf0e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c283ee-90f2-4fc5-9455-f8b43748ab41]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Flow 'volume_create_manager' (5d393beb-b037-4659-a618-6a0be9253d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321b3ece-6f0f-4948-a6ce-28266ebe56bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321b3ece-6f0f-4948-a6ce-28266ebe56bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1130222910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95945cf5-6692-4b01-950d-d7034cbec238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3463ad48647cbb6b54b31f75d5e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:45Z,use_quota=True,user_id='fe0749a94a6b47f2b8ed68cf81233f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a13cf35-04da-4ea2-8463-6fd7c684b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a13cf35-04da-4ea2-8463-6fd7c684b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6bbde1-0fa0-42a7-813f-c8909a658d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6bbde1-0fa0-42a7-813f-c8909a658d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95945cf5-6692-4b01-950d-d7034cbec238', 'volume_name': 'volume-95945cf5-6692-4b01-950d-d7034cbec238', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164e8750-8c13-4684-bd55-5541963b8ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164e8750-8c13-4684-bd55-5541963b8ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faeea873-c9af-4d75-a065-0d3943b973cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:44 devstack sudo[100822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1
Nov 05 12:03:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Volume 95945cf5-6692-4b01-950d-d7034cbec238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95945cf5-6692-4b01-950d-d7034cbec238', 'volume_size': 1}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:44 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1130222910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95945cf5-6692-4b01-950d-d7034cbec238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3463ad48647cbb6b54b31f75d5e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:45Z,use_quota=True,user_id='fe0749a94a6b47f2b8ed68cf81233f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Creating volume 95945cf5-6692-4b01-950d-d7034cbec238 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:44 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:44 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238 1073741824
Nov 05 12:03:44 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:45 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1" returned: 0 in 0.513s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:45 devstack sudo[100832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1
Nov 05 12:03:45 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:45 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:45 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "cinder-59fbe580-d611-43c9-ad3c-0ca336bd6e50-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-59fbe580-d611-43c9-ad3c-0ca336bd6e50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "cinder-quobyte-59fbe580-d611-43c9-ad3c-0ca336bd6e50" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:45 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238 1073741824" returned: 0 in 0.726s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-quobyte-59fbe580-d611-43c9-ad3c-0ca336bd6e50" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Deleting offline snapshot 59fbe580-d611-43c9-ad3c-0ca336bd6e50 of volume 9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:03:45 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] snapshot_file for this snap is: volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c3e3515-9710-4db0-9e40-fb58d8edf0e1" returned: 0 in 0.447s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed6c90-c72a-46b6-9ca4-8658b4f4b780]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:45 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Lock "cinder-quobyte-4c3e3515-9710-4db0-9e40-fb58d8edf0e1" released by "delete_volume" :: held 1.049s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:45 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238
Nov 05 12:03:45 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-71081fcf-ad19-48eb-8416-00258e2b6962 req-62f336cc-a47b-4301-b9c1-1c7ea749aebb tempest-TestShelveInstance-1369245379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Created reservations ['f8877ba8-c493-46fc-89c9-684385fa6e29', '97d63645-e7a3-4d0a-8ec8-82024327aa3b', '3d82e52f-2a28-4679-8d6a-614639f79eb2', '8f280017-7430-4f1b-a199-c2b25d7131fc'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:45 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:45 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:45 devstack sudo[100851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:45 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:45 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-71081fcf-ad19-48eb-8416-00258e2b6962 req-62f336cc-a47b-4301-b9c1-1c7ea749aebb tempest-TestShelveInstance-1369245379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.221s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faeea873-c9af-4d75-a065-0d3943b973cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95945cf5-6692-4b01-950d-d7034cbec238', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad48ef70-6e56-40fb-9807-222b8d7712fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-71081fcf-ad19-48eb-8416-00258e2b6962 req-62f336cc-a47b-4301-b9c1-1c7ea749aebb tempest-TestShelveInstance-1369245379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:46 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Volume volume-95945cf5-6692-4b01-950d-d7034cbec238 (95945cf5-6692-4b01-950d-d7034cbec238): created successfully
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad48ef70-6e56-40fb-9807-222b8d7712fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Flow 'volume_create_manager' (5d393beb-b037-4659-a618-6a0be9253d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ebf2a6f4-2699-4485-b4f4-70dcc984df40 tempest-VolumesListAdminTestJSON-746449436 None] Created volume successfully.
Nov 05 12:03:46 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9315b39c-402c-4a73-bd48-0369a4d3ef41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:46 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-71081fcf-ad19-48eb-8416-00258e2b6962 req-62f336cc-a47b-4301-b9c1-1c7ea749aebb tempest-TestShelveInstance-1369245379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a734133-2115-4073-a376-d6aa37c4b173', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Deleted volume successfully.
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a2a21-c91e-4451-8036-8b327efc0de2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0cbe3bc7-ff83-4868-b55e-876b0e40bd4d tempest-ProjectReaderTests-864410469 None] Lock "cinder-4c3e3515-9710-4db0-9e40-fb58d8edf0e1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-71081fcf-ad19-48eb-8416-00258e2b6962 req-62f336cc-a47b-4301-b9c1-1c7ea749aebb tempest-TestShelveInstance-1369245379 None] attachment_update completed successfully.
Nov 05 12:03:46 devstack sudo[100858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41
Nov 05 12:03:46 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:46 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41" returned: 0 in 0.405s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:46 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:46 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:47 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:47 devstack sudo[100869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50
Nov 05 12:03:47 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:47 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41.59fbe580-d611-43c9-ad3c-0ca336bd6e50" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-quobyte-59fbe580-d611-43c9-ad3c-0ca336bd6e50" released by "_delete_snapshot" :: held 1.806s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" released by "delete_snapshot" :: held 1.880s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Created reservations ['c9837c67-4120-43ad-b1d6-fb03b52d2c55', '577d5b59-8e51-4921-aec2-b46b63007401', '5a7ca415-942a-431c-ba7a-21e8d805bd5c', 'e74bc157-6efb-49d2-92a0-506d08743af7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Delete snapshot completed successfully.
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428bc87c-023e-4f16-b45e-88c0538e5594 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-59fbe580-d611-43c9-ad3c-0ca336bd6e50-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "cinder-9315b39c-402c-4a73-bd48-0369a4d3ef41-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-9315b39c-402c-4a73-bd48-0369a4d3ef41-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Flow 'volume_create_manager' (dc75071b-368a-447f-b9eb-7b18be986c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe6b519-d492-4f55-af3f-10623bd53e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe6b519-d492-4f55-af3f-10623bd53e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce6da37f60c455ea581e3d18371fadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:48Z,use_quota=True,user_id='da21ac0bd3214f6a947ed1f389504fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11672f53-c34d-45de-8816-ce04f6b258d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11672f53-c34d-45de-8816-ce04f6b258d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8ff0fe-2263-497d-8064-0050b9d454a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8ff0fe-2263-497d-8064-0050b9d454a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2', 'volume_name': 'volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a07eaf4-a952-4d31-8514-2773dcb704dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a07eaf4-a952-4d31-8514-2773dcb704dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddab497-edcc-4d4c-a07d-bb3f77711c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Volume bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2', 'volume_size': 1}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce6da37f60c455ea581e3d18371fadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:48Z,use_quota=True,user_id='da21ac0bd3214f6a947ed1f389504fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Creating volume bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:48 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:48 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 1073741824
Nov 05 12:03:48 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c6dc63-ef4e-4acb-86f8-1952e98f84ff]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:48 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41
Nov 05 12:03:48 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:48 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 1073741824" returned: 0 in 0.614s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:48 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41" returned: 0 in 0.526s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:48 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41
Nov 05 12:03:48 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:48 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2
Nov 05 12:03:48 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:49 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9315b39c-402c-4a73-bd48-0369a4d3ef41" returned: 0 in 0.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:49 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2" returned: 0 in 0.356s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddab497-edcc-4d4c-a07d-bb3f77711c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f96763-9230-4bc6-8a6c-b8ecc948ff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-quobyte-9315b39c-402c-4a73-bd48-0369a4d3ef41" released by "delete_volume" :: held 1.029s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Volume volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 (bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2): created successfully
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f96763-9230-4bc6-8a6c-b8ecc948ff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Flow 'volume_create_manager' (dc75071b-368a-447f-b9eb-7b18be986c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-88388b3b-b36a-4665-8c92-15fe05b08853 tempest-VolumesListAdminTestJSON-1966056650 None] Created volume successfully.
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Created reservations ['0ff3a04b-e115-4870-94f6-09b47d8185dd', '0d0ceb8b-e1c0-471e-8513-a0d0feb80fbd', '0ef4f28c-3e32-4f94-bb2c-f60f71d1c175', 'c15e3a76-5afb-47ff-b948-bfda8d807394'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:49 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:49 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:49 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.356s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Deleted volume successfully.
Nov 05 12:03:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7ad36ab8-a105-48fd-aa69-362adaef0438 tempest-SnapshotsActionsTest-655492339 None] Lock "cinder-9315b39c-402c-4a73-bd48-0369a4d3ef41-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Acquiring lock "cinder-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Lock "cinder-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Acquiring lock "cinder-quobyte-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Lock "cinder-quobyte-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d4647-3ca0-46f5-bbdb-476864deee92]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "cinder-95945cf5-6692-4b01-950d-d7034cbec238-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-95945cf5-6692-4b01-950d-d7034cbec238-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:50 devstack sudo[101351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2
Nov 05 12:03:50 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "cinder-quobyte-95945cf5-6692-4b01-950d-d7034cbec238" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-quobyte-95945cf5-6692-4b01-950d-d7034cbec238" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[447fd165-17fb-42e4-9f45-3ad45f04505d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:50 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2" returned: 0 in 0.557s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:50 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238
Nov 05 12:03:50 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:51 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2
Nov 05 12:03:51 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:51 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238" returned: 0 in 0.689s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:51 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2" returned: 0 in 0.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:51 devstack sudo[101383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238
Nov 05 12:03:51 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Lock "cinder-quobyte-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2" released by "delete_volume" :: held 1.129s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Created reservations ['4aa20ebd-a722-410a-baf2-5d9dbd063273', '41d70688-73a5-42ff-ad1b-be0ec41118ab', '3b693a8a-4ec7-486a-87b7-99ea07f4d795', 'd4ac9f18-5d9f-4572-ab4d-4e814664a8db'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:51 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95945cf5-6692-4b01-950d-d7034cbec238" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:51 devstack sudo[101386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:51 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-quobyte-95945cf5-6692-4b01-950d-d7034cbec238" released by "delete_volume" :: held 1.109s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Created reservations ['86f68fdf-0dff-4e52-b27b-f16eb88594c4', '8573bd60-e60d-4a46-9166-0d5c4c2017bb', '077ef5ca-c306-4ab8-906e-3e259552ceda', 'fa7b6ec6-4d3b-48dc-94b1-2c777ad438c5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:52 devstack sudo[101391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:52 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:52 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Deleted volume successfully.
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287fc978-f2bf-4961-bbab-22992d55ea6b tempest-VolumesListAdminTestJSON-1966056650 None] Lock "cinder-bb1c8d93-6a35-4f15-8db2-6f90a7fa9de2-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:52 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.339s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Deleted volume successfully.
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b3b09ec-cd67-40ac-9503-799e4ca897c7 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-95945cf5-6692-4b01-950d-d7034cbec238-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "cinder-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "cinder-quobyte-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-quobyte-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[045fa85c-059e-4edc-8041-41470321ba22]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:53 devstack sudo[101394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563
Nov 05 12:03:53 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:53 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563" returned: 0 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:53 devstack sudo[101400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563
Nov 05 12:03:53 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:53 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-quobyte-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563" released by "delete_volume" :: held 0.861s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Created reservations ['566dc6eb-3dcf-472d-a666-fd33978f7e5c', '5fdeae6b-1514-480f-adb2-c9f5c55c09e8', '712dd16c-713a-44c1-ba1e-60fa91b050b1', '6e3e4b59-7af9-49bc-a2d2-9f4c51979a0f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:54 devstack sudo[101404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:54 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "cinder-f32fbc43-ca92-4e7b-9286-8dd5852aec1f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-f32fbc43-ca92-4e7b-9286-8dd5852aec1f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "cinder-quobyte-f32fbc43-ca92-4e7b-9286-8dd5852aec1f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-quobyte-f32fbc43-ca92-4e7b-9286-8dd5852aec1f" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d162e4-a471-47ef-8d95-5b66650212c4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:54 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.520s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Deleted volume successfully.
Nov 05 12:03:54 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f
Nov 05 12:03:54 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6161b44b-7298-45b0-a875-d75a0fec8d30 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-3bcee18d-c42f-4d8c-a0cf-5a5e7b438563-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:55 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f" returned: 0 in 0.484s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:55 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f
Nov 05 12:03:55 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:55 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f32fbc43-ca92-4e7b-9286-8dd5852aec1f" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-quobyte-f32fbc43-ca92-4e7b-9286-8dd5852aec1f" released by "delete_volume" :: held 0.866s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Created reservations ['fd8cc3e1-b4f0-41b5-9d09-57a377be58f1', '28ae5654-b67c-4fad-9cb3-f8bbb3635b88', 'd511f3ee-c841-461a-906c-61e6e4c8b0bc', '6ff6afce-1558-4f56-8e3e-3d74e58ac1ab'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:55 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:03:55 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:55 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.361s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Deleted volume successfully.
Nov 05 12:03:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15fc800-cd75-493d-9cfd-a06376bfa772 tempest-VolumesListAdminTestJSON-746449436 None] Lock "cinder-f32fbc43-ca92-4e7b-9286-8dd5852aec1f-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Flow 'volume_create_manager' (86169566-ee4a-4374-bd59-2486043bd31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473d3650-d311-477e-98be-03133f2797bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473d3650-d311-477e-98be-03133f2797bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1712998161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c04b56-fb60-4738-aa59-06e7161dcfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d88e10abcb54bb193912d292c52c0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:59Z,use_quota=True,user_id='9d5875db992744e7aa4a19cd15bd52d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8ec538-e9ed-4afb-a07e-b72ac1ac4e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8ec538-e9ed-4afb-a07e-b72ac1ac4e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db50802a-7cfd-4ad9-baf4-2a746ea7ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db50802a-7cfd-4ad9-baf4-2a746ea7ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c04b56-fb60-4738-aa59-06e7161dcfee', 'volume_name': 'volume-20c04b56-fb60-4738-aa59-06e7161dcfee', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67b849b-f6a7-4347-b588-1a22a4c29f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67b849b-f6a7-4347-b588-1a22a4c29f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831be073-acb2-46dd-944a-fc3a0c6f8d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Volume 20c04b56-fb60-4738-aa59-06e7161dcfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c04b56-fb60-4738-aa59-06e7161dcfee', 'volume_size': 1}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1712998161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c04b56-fb60-4738-aa59-06e7161dcfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d88e10abcb54bb193912d292c52c0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:59Z,use_quota=True,user_id='9d5875db992744e7aa4a19cd15bd52d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Creating volume 20c04b56-fb60-4738-aa59-06e7161dcfee {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:03:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:58 devstack sudo[101418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee 1073741824
Nov 05 12:03:58 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:59 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee 1073741824" returned: 0 in 0.577s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:59 devstack sudo[101457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee
Nov 05 12:03:59 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:59 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831be073-acb2-46dd-944a-fc3a0c6f8d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c04b56-fb60-4738-aa59-06e7161dcfee', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b62644e-f309-4c44-9890-cfed30849c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Volume volume-20c04b56-fb60-4738-aa59-06e7161dcfee (20c04b56-fb60-4738-aa59-06e7161dcfee): created successfully
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b62644e-f309-4c44-9890-cfed30849c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Flow 'volume_create_manager' (86169566-ee4a-4374-bd59-2486043bd31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ec2cdb70-d48b-4303-9e2a-6373f6e5aa06 tempest-VolumeQuotasNegativeTestJSON-407567395 None] Created volume successfully.
Nov 05 12:04:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Acquiring lock "cinder-20c04b56-fb60-4738-aa59-06e7161dcfee-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "cinder-20c04b56-fb60-4738-aa59-06e7161dcfee-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Acquiring lock "cinder-quobyte-20c04b56-fb60-4738-aa59-06e7161dcfee" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "cinder-quobyte-20c04b56-fb60-4738-aa59-06e7161dcfee" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a1f1e-f2d6-4ada-8960-57dc06cdffeb]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:02 devstack sudo[101463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee
Nov 05 12:04:02 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:03 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:03 devstack sudo[101468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee
Nov 05 12:04:03 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:03 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-20c04b56-fb60-4738-aa59-06e7161dcfee" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "cinder-quobyte-20c04b56-fb60-4738-aa59-06e7161dcfee" released by "delete_volume" :: held 0.795s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Created reservations ['d097348d-c9d2-4e8e-b592-57c4746cf15d', '7e1b57f1-2632-43d8-88f7-f97b86e02755', '286d6efc-86a5-4ce2-87f0-0cc25d00b176', '9c421b74-e2fd-4d38-8859-799035e3cb30'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:03 devstack sudo[101471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:04:03 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:03 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Deleted volume successfully.
Nov 05 12:04:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57fc9f39-d999-4b62-bcce-81e3766becad tempest-VolumeQuotasNegativeTestJSON-407567395 None] Lock "cinder-20c04b56-fb60-4738-aa59-06e7161dcfee-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Flow 'volume_create_manager' (4cd019b7-3039-43c2-816f-b32ce743e137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baaf5004-ebd2-43a2-86db-614358517a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baaf5004-ebd2-43a2-86db-614358517a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1127212011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372902c2-96bd-4d2e-a05c-e78037160a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcaa3c38b9143b981bf1835db09f8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:06Z,use_quota=True,user_id='ef7b20d37567438f9ef667e6ed62877e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c6dbbc-54ff-4ab7-8e6d-9cb4108cc5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c6dbbc-54ff-4ab7-8e6d-9cb4108cc5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e0d306-3287-4f09-9336-8f5da4656551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e0d306-3287-4f09-9336-8f5da4656551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '372902c2-96bd-4d2e-a05c-e78037160a9c', 'volume_name': 'volume-372902c2-96bd-4d2e-a05c-e78037160a9c', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449d82210>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a512e6-f1f0-4019-a04d-2bd3e9e56a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a512e6-f1f0-4019-a04d-2bd3e9e56a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cd3b9d-ad61-4ff8-8a47-381b2182993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Volume 372902c2-96bd-4d2e-a05c-e78037160a9c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-372902c2-96bd-4d2e-a05c-e78037160a9c', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449d82210>}
Nov 05 12:04:06 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Trying to clone 372902c2-96bd-4d2e-a05c-e78037160a9c from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:04:07 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:04:07 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 12:04:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2956fb-cd94-45e1-bddf-2dfd2c4eb03e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:07 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD
Nov 05 12:04:07 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:07 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:07 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 is fetched for user ef7b20d37567438f9ef667e6ed62877e. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:04:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8d27db-ec91-4792-a9f6-c0252c905e2a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:07 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD
Nov 05 12:04:07 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:08 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1127212011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372902c2-96bd-4d2e-a05c-e78037160a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcaa3c38b9143b981bf1835db09f8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:06Z,use_quota=True,user_id='ef7b20d37567438f9ef667e6ed62877e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Creating volume 372902c2-96bd-4d2e-a05c-e78037160a9c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:08 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:08 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c 1073741824
Nov 05 12:04:08 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:08 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c 1073741824" returned: 0 in 0.492s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:08 devstack sudo[101505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c
Nov 05 12:04:08 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:08 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Attempting download of 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 372902c2-96bd-4d2e-a05c-e78037160a9c. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[11acaf1f-8da1-4432-9579-a19dfcd9e5c2]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_v_wd7aai {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:09 devstack sudo[101508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_v_wd7aai
Nov 05 12:04:09 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:09 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_v_wd7aai" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_v_wd7aai {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:09 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_v_wd7aai
Nov 05 12:04:09 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:09 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_v_wd7aai" returned: 1 in 0.339s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_v_wd7aai' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ad586e-dfd5-4a21-8109-8efbb60715f0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:09 devstack sudo[101541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD
Nov 05 12:04:09 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:09 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] 97690ee3-6eec-4469-b729-e1fcbb2cb426 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:04:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:09 devstack sudo[101546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c
Nov 05 12:04:09 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Flow 'volume_create_manager' (3df74c53-c8e4-4234-af86-e2bfd51a0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6472f075-3d8c-410e-b428-c73b53aa7fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6472f075-3d8c-410e-b428-c73b53aa7fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1581782937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d17a7c-d43e-404c-9e2c-14385e2ef612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd30a25825614f439232bcdfc0b480fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:11Z,use_quota=True,user_id='5992988522da4365bf706a93cce7d28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9404870-44ac-4926-8986-6789554eddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9404870-44ac-4926-8986-6789554eddb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7105c996-c17d-4f78-8486-0077b349c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7105c996-c17d-4f78-8486-0077b349c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d17a7c-d43e-404c-9e2c-14385e2ef612', 'volume_name': 'volume-58d17a7c-d43e-404c-9e2c-14385e2ef612', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d71b7d-9985-4d25-8c4e-35dc008bded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d71b7d-9985-4d25-8c4e-35dc008bded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f99a85-07f2-4878-b47d-feac315e6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Volume 58d17a7c-d43e-404c-9e2c-14385e2ef612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d17a7c-d43e-404c-9e2c-14385e2ef612', 'volume_size': 1}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1581782937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d17a7c-d43e-404c-9e2c-14385e2ef612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd30a25825614f439232bcdfc0b480fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:11Z,use_quota=True,user_id='5992988522da4365bf706a93cce7d28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Creating volume 58d17a7c-d43e-404c-9e2c-14385e2ef612 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:10 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:04:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:10 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612 1073741824
Nov 05 12:04:10 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:11 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612 1073741824" returned: 0 in 0.485s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:11 devstack sudo[101559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612
Nov 05 12:04:11 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:11 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f99a85-07f2-4878-b47d-feac315e6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d17a7c-d43e-404c-9e2c-14385e2ef612', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2223c394-db2a-481b-8502-002c7487fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Volume volume-58d17a7c-d43e-404c-9e2c-14385e2ef612 (58d17a7c-d43e-404c-9e2c-14385e2ef612): created successfully
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2223c394-db2a-481b-8502-002c7487fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Flow 'volume_create_manager' (3df74c53-c8e4-4234-af86-e2bfd51a0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3ec2f3bc-7682-470b-8ead-da113b1ad180 tempest-VolumesServicesTestJSON-1657910432 None] Created volume successfully.
Nov 05 12:04:11 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c" returned: 0 in 1.986s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_pjtql480devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:04:11 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Converted 112.00 MB image at 56.36 MB/s
Nov 05 12:04:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:11 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c 1G
Nov 05 12:04:11 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:12 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c 1G" returned: 0 in 0.308s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Downloaded image 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 372902c2-96bd-4d2e-a05c-e78037160a9c successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 for user ef7b20d37567438f9ef667e6ed62877e is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Marking volume 372902c2-96bd-4d2e-a05c-e78037160a9c as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Copying metadata from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 to 372902c2-96bd-4d2e-a05c-e78037160a9c. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Creating volume glance metadata for volume 372902c2-96bd-4d2e-a05c-e78037160a9c backed by image 97690ee3-6eec-4469-b729-e1fcbb2cb426 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cd3b9d-ad61-4ff8-8a47-381b2182993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372902c2-96bd-4d2e-a05c-e78037160a9c', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449d82210>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f70da49-5c29-48b6-9484-1cff13fb72ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Volume volume-372902c2-96bd-4d2e-a05c-e78037160a9c (372902c2-96bd-4d2e-a05c-e78037160a9c): created successfully
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f70da49-5c29-48b6-9484-1cff13fb72ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Flow 'volume_create_manager' (4cd019b7-3039-43c2-816f-b32ce743e137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-904ba5c1-7bbc-4f2b-8934-333094729c46 tempest-VolumesImageMetadata-1218230757 None] Created volume successfully.
Nov 05 12:04:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Acquiring lock "cinder-58d17a7c-d43e-404c-9e2c-14385e2ef612-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Lock "cinder-58d17a7c-d43e-404c-9e2c-14385e2ef612-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Acquiring lock "cinder-quobyte-58d17a7c-d43e-404c-9e2c-14385e2ef612" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Lock "cinder-quobyte-58d17a7c-d43e-404c-9e2c-14385e2ef612" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Acquiring lock "cinder-372902c2-96bd-4d2e-a05c-e78037160a9c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc41e38-34a5-4c94-9425-931860f03010]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Lock "cinder-372902c2-96bd-4d2e-a05c-e78037160a9c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Acquiring lock "cinder-quobyte-372902c2-96bd-4d2e-a05c-e78037160a9c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Lock "cinder-quobyte-372902c2-96bd-4d2e-a05c-e78037160a9c" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be79d43-bac5-43e7-a634-3efc3fdd69a0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:13 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612
Nov 05 12:04:13 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:13 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c
Nov 05 12:04:13 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:13 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:13 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612
Nov 05 12:04:13 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:13 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:13 devstack sudo[101579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c
Nov 05 12:04:13 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:13 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-58d17a7c-d43e-404c-9e2c-14385e2ef612" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Lock "cinder-quobyte-58d17a7c-d43e-404c-9e2c-14385e2ef612" released by "delete_volume" :: held 0.688s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Created reservations ['e27a71ed-6f93-4fba-8138-8057ff6070f3', 'ac0da5fd-238a-4cc0-b451-6bfc932b4c04', '0d146d4e-8989-4950-8d61-b585a06de7c9', '67f1c880-ecd3-40dd-b4ee-889eaa4f9996'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:13 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-372902c2-96bd-4d2e-a05c-e78037160a9c" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Lock "cinder-quobyte-372902c2-96bd-4d2e-a05c-e78037160a9c" released by "delete_volume" :: held 0.684s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:13 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:04:13 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Created reservations ['f753b1c2-883c-42a4-9443-787376c5bd98', 'e3ab936e-3e37-4cf5-8bb1-777b09cc0759', '44d77de6-65d6-4a4a-adc2-80136abc8c9f', '7e234fa4-95d5-456a-9c82-0d33c9817d48'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:14 devstack sudo[101586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:04:14 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:14 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Deleted volume successfully.
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6d75c84-5083-41fa-8faa-6c39763d451e tempest-VolumesServicesTestJSON-1657910432 None] Lock "cinder-58d17a7c-d43e-404c-9e2c-14385e2ef612-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:14 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Deleted volume successfully.
Nov 05 12:04:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8974c03f-a18c-42e6-b2f2-4c1197a2004f tempest-VolumesImageMetadata-1218230757 None] Lock "cinder-372902c2-96bd-4d2e-a05c-e78037160a9c-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Flow 'volume_create_manager' (0e7343b1-8fb8-4a6f-8842-546ddc71e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68461c6-09a1-4a72-a07a-caef9ce52da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68461c6-09a1-4a72-a07a-caef9ce52da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-971553243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b71b10-030b-4104-b9e4-6eb17ac1639f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c87fcf8d4412d89deefcc426ae641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:20Z,use_quota=True,user_id='dfbd443503fe4bd19d75ebf079fc2227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d88f42b-9c74-476c-849e-366695c64319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d88f42b-9c74-476c-849e-366695c64319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8387c9-6f0e-4791-ac22-df2b3c413ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8387c9-6f0e-4791-ac22-df2b3c413ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b71b10-030b-4104-b9e4-6eb17ac1639f', 'volume_name': 'volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41d866c-c98e-4d82-b960-107f2743d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41d866c-c98e-4d82-b960-107f2743d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f913144-f1fd-4164-9435-7a9a7b3a4a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Volume f3b71b10-030b-4104-b9e4-6eb17ac1639f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f', 'volume_size': 1}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-971553243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b71b10-030b-4104-b9e4-6eb17ac1639f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c87fcf8d4412d89deefcc426ae641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:20Z,use_quota=True,user_id='dfbd443503fe4bd19d75ebf079fc2227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Creating volume f3b71b10-030b-4104-b9e4-6eb17ac1639f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:20 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:04:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:20 devstack sudo[101591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f 1073741824
Nov 05 12:04:20 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:21 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f 1073741824" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:21 devstack sudo[101596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f
Nov 05 12:04:21 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:21 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f913144-f1fd-4164-9435-7a9a7b3a4a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999f6872-5234-4ac0-9288-d777e7bab3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:21 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Volume volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f (f3b71b10-030b-4104-b9e4-6eb17ac1639f): created successfully
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999f6872-5234-4ac0-9288-d777e7bab3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Flow 'volume_create_manager' (0e7343b1-8fb8-4a6f-8842-546ddc71e7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e2e3308c-f6f8-43c4-8639-a5611e7bfdfc tempest-VolumesTransfersV357Test-568502770 None] Created volume successfully.
Nov 05 12:04:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-26f4e4fc-42cb-4a2e-9b50-9c02da4cfd67 tempest-VolumesTransfersV357Test-188624473 None] Transfer volume completed successfully.
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Acquiring lock "cinder-f3b71b10-030b-4104-b9e4-6eb17ac1639f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-f3b71b10-030b-4104-b9e4-6eb17ac1639f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Acquiring lock "cinder-quobyte-f3b71b10-030b-4104-b9e4-6eb17ac1639f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-quobyte-f3b71b10-030b-4104-b9e4-6eb17ac1639f" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa310f1-be3a-4ecb-a9f9-f80fe76e1938]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:24 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f
Nov 05 12:04:24 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:24 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f" returned: 0 in 0.401s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:24 devstack sudo[101605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f
Nov 05 12:04:24 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:25 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3b71b10-030b-4104-b9e4-6eb17ac1639f" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-quobyte-f3b71b10-030b-4104-b9e4-6eb17ac1639f" released by "delete_volume" :: held 0.716s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Created reservations ['68648bce-72f7-4130-b3fc-976e375047d8', '381c485b-7060-453c-b2f5-c5f25e0f94d1', '495ef7cf-ac42-4d10-a67e-1890385d995e', '9ac00d14-1eb2-47dc-bf9c-892abbff03ca'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:25 devstack sudo[101608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:04:25 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:25 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Deleted volume successfully.
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ed59bc9-3b5e-4504-8da6-1823e7258081 tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-f3b71b10-030b-4104-b9e4-6eb17ac1639f-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Flow 'volume_create_manager' (94c2f9cb-6fdb-4e90-9a3e-ee551c11a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf2d9f-4755-42f5-b0b3-fc040f71f5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf2d9f-4755-42f5-b0b3-fc040f71f5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1397874693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d39e0eb-c8b6-4143-9732-45d7c9a2beec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c87fcf8d4412d89deefcc426ae641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:26Z,use_quota=True,user_id='dfbd443503fe4bd19d75ebf079fc2227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2348e894-5d75-4413-834f-cedde25f9544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2348e894-5d75-4413-834f-cedde25f9544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3baf5d71-4d9d-46af-87a6-82b8092648b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3baf5d71-4d9d-46af-87a6-82b8092648b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d39e0eb-c8b6-4143-9732-45d7c9a2beec', 'volume_name': 'volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f84adc-b591-418d-9b10-41b10e61094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f84adc-b591-418d-9b10-41b10e61094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce30177a-e626-4c7c-b54c-660b38ae104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Volume 1d39e0eb-c8b6-4143-9732-45d7c9a2beec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec', 'volume_size': 1}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1397874693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d39e0eb-c8b6-4143-9732-45d7c9a2beec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c87fcf8d4412d89deefcc426ae641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:26Z,use_quota=True,user_id='dfbd443503fe4bd19d75ebf079fc2227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Creating volume 1d39e0eb-c8b6-4143-9732-45d7c9a2beec {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:26 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:26 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec 1073741824
Nov 05 12:04:26 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:26 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec 1073741824" returned: 0 in 0.439s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:26 devstack sudo[101618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec
Nov 05 12:04:26 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:26 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce30177a-e626-4c7c-b54c-660b38ae104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2db4390-fab8-457f-8f5c-a65946481d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Volume volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec (1d39e0eb-c8b6-4143-9732-45d7c9a2beec): created successfully
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2db4390-fab8-457f-8f5c-a65946481d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Flow 'volume_create_manager' (94c2f9cb-6fdb-4e90-9a3e-ee551c11a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-de56328a-ae7a-44c4-a8f9-5f497e08f736 tempest-VolumesTransfersV357Test-568502770 None] Created volume successfully.
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Acquiring lock "cinder-1d39e0eb-c8b6-4143-9732-45d7c9a2beec-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-1d39e0eb-c8b6-4143-9732-45d7c9a2beec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=136,cinder:INSERT=49,cinder:UPDATE=185,cinder:DELETE=11 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Acquiring lock "cinder-quobyte-1d39e0eb-c8b6-4143-9732-45d7c9a2beec" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-quobyte-1d39e0eb-c8b6-4143-9732-45d7c9a2beec" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb754d5e-eb51-46a8-96d0-193eae537c4d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:27 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec
Nov 05 12:04:27 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:27 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:27 devstack sudo[101626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec
Nov 05 12:04:27 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:28 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1d39e0eb-c8b6-4143-9732-45d7c9a2beec" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-quobyte-1d39e0eb-c8b6-4143-9732-45d7c9a2beec" released by "delete_volume" :: held 0.680s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Created reservations ['cccc6b2b-585f-423c-a27e-88b588fa18fa', 'cdd024d5-8c86-433a-ae25-19497e19d3ef', '2bc80a5b-186c-4a8d-9f93-23494b62e35f', '242cf7ee-fa15-4186-93bf-f3a69d8bd704'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:28 devstack sudo[101629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:04:28 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:28 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Deleted volume successfully.
Nov 05 12:04:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-76baf00d-4dd2-411a-8397-d60685dd7b8a tempest-VolumesTransfersV357Test-1868054790 None] Lock "cinder-1d39e0eb-c8b6-4143-9732-45d7c9a2beec-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-b305d43d-0009-4b86-98b5-81436a261edf tempest-TestShelveInstance-1369245379 None] Terminate volume connection completed successfully.
Nov 05 12:04:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-b305d43d-0009-4b86-98b5-81436a261edf tempest-TestShelveInstance-1369245379 None] Deleting attachment 9a734133-2115-4073-a376-d6aa37c4b173. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:04:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Acquiring lock "cinder-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Lock "cinder-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Acquiring lock "cinder-quobyte-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Lock "cinder-quobyte-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc5643-313e-4ecf-98db-9f52aa0902d2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:32 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4
Nov 05 12:04:32 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:33 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4" returned: 0 in 0.523s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:33 devstack sudo[101668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4
Nov 05 12:04:33 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:33 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Lock "cinder-quobyte-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4" released by "delete_volume" :: held 0.898s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG cinder.quota [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Created reservations ['f0be41b1-b323-49a2-8a57-8ae4542cd5dd', 'bac06cd4-08d3-42df-a15f-c655d4664073', 'ecac1ccc-870c-478a-b194-7066cfc07d0a', '7ab6167c-c4df-4447-b7a5-c5dc9a6fdd82'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:33 devstack sudo[101672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:04:33 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:34 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.343s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:34 devstack cinder-volume[87184]: DEBUG cinder.manager [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Deleted volume successfully.
Nov 05 12:04:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-5ab67951-643b-42f0-8d3b-c9e42676dc9c req-176c04a8-403e-48cf-a11b-20864de3b22f tempest-TestShelveInstance-1369245379 None] Lock "cinder-3fcb189b-7da2-4bf6-b9d7-8b59f6dfaef4-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=148,cinder:DELETE=15,cinder:SELECT=133,cinder:INSERT=43 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Flow 'volume_create_manager' (14c27c09-7334-415d-8a3f-58173ba1e4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857c2726-fe81-4ddd-bdf3-c60f4675e3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857c2726-fe81-4ddd-bdf3-c60f4675e3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1504909337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a720f9e-0a52-4174-a4db-b76a7c156676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3df8bfd2d744715996d4b79190d4ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:37Z,use_quota=True,user_id='49bbc14daab84be496d5a4133db372c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd36c1a-b3a9-4012-a5a9-a3dac960fd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd36c1a-b3a9-4012-a5a9-a3dac960fd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009703cd-d70e-448d-aa1e-9acdce01fa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009703cd-d70e-448d-aa1e-9acdce01fa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a720f9e-0a52-4174-a4db-b76a7c156676', 'volume_name': 'volume-5a720f9e-0a52-4174-a4db-b76a7c156676', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d28ade-ab8b-4666-b6cc-1998fd6b61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d28ade-ab8b-4666-b6cc-1998fd6b61f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952bfb04-ab93-4336-b28a-bfe1d187cb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Volume 5a720f9e-0a52-4174-a4db-b76a7c156676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a720f9e-0a52-4174-a4db-b76a7c156676', 'volume_size': 1}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1504909337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a720f9e-0a52-4174-a4db-b76a7c156676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3df8bfd2d744715996d4b79190d4ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:37Z,use_quota=True,user_id='49bbc14daab84be496d5a4133db372c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Creating volume 5a720f9e-0a52-4174-a4db-b76a7c156676 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:04:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:36 devstack sudo[101679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676 1073741824
Nov 05 12:04:36 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:37 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676 1073741824" returned: 0 in 0.639s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:37 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676
Nov 05 12:04:37 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:37 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952bfb04-ab93-4336-b28a-bfe1d187cb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a720f9e-0a52-4174-a4db-b76a7c156676', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2849effa-5261-4f2c-83f7-edc9b5df2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Volume volume-5a720f9e-0a52-4174-a4db-b76a7c156676 (5a720f9e-0a52-4174-a4db-b76a7c156676): created successfully
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2849effa-5261-4f2c-83f7-edc9b5df2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Flow 'volume_create_manager' (14c27c09-7334-415d-8a3f-58173ba1e4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-77de851f-d631-4a01-ac43-081ad31c2be1 tempest-VolumesNegativeTest-622688377 None] Created volume successfully.
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:45 devstack sudo[101703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:04:45 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:45 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:04:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:04:47 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:04:47 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:04:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Flow 'volume_create_manager' (ad5bbb2e-626c-4256-9fc8-1cb972620b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856a1f5-7183-4254-ae46-bbfb82c43b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856a1f5-7183-4254-ae46-bbfb82c43b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-139214327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8304f12a-7d3b-4f30-93ca-b7eefd6f4194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2be037f0e94b2085f72f4af108198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:54Z,use_quota=True,user_id='0e6554677619453fb11a49ffe83abcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7731c4e4-9241-40c8-a8d4-1ee53777f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7731c4e4-9241-40c8-a8d4-1ee53777f325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f1530-d0fd-4be4-a6c3-ce702db318df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f1530-d0fd-4be4-a6c3-ce702db318df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8304f12a-7d3b-4f30-93ca-b7eefd6f4194', 'volume_name': 'volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad310fa6-683e-4674-9a30-fd3a6a6718e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad310fa6-683e-4674-9a30-fd3a6a6718e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9232066f-4eee-4eb5-82c6-d2db78a2a17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Volume 8304f12a-7d3b-4f30-93ca-b7eefd6f4194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194', 'volume_size': 1}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-139214327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8304f12a-7d3b-4f30-93ca-b7eefd6f4194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2be037f0e94b2085f72f4af108198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:54Z,use_quota=True,user_id='0e6554677619453fb11a49ffe83abcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Creating volume 8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:54 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 1073741824
Nov 05 12:04:54 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:54 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 1073741824" returned: 0 in 0.728s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:54 devstack sudo[101798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194
Nov 05 12:04:54 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:55 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9232066f-4eee-4eb5-82c6-d2db78a2a17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c2d386-96a6-4957-894b-4caaf83e3ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Volume volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 (8304f12a-7d3b-4f30-93ca-b7eefd6f4194): created successfully
Nov 05 12:04:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c2d386-96a6-4957-894b-4caaf83e3ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Flow 'volume_create_manager' (ad5bbb2e-626c-4256-9fc8-1cb972620b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d3996c3b-6af8-4547-ae98-401f40df4152 tempest-VolumeDependencyTests-678576538 None] Created volume successfully.
Nov 05 12:04:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Creating offline snapshot 7170cc8f-e770-4cbd-8bc7-25358519f4bc of volume 8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:04:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3688b15a-5bd2-4002-b980-6704e8bd5adf]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:56 devstack sudo[101806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194
Nov 05 12:04:56 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:57 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" returned: 0 in 0.513s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:57 devstack sudo[101827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc 1G
Nov 05 12:04:57 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:57 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc 1G" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:57 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc
Nov 05 12:04:57 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:58 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:58 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc is being set with open permissions: ugo+rw
Nov 05 12:04:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:58 devstack sudo[101839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc
Nov 05 12:04:58 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:58 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:58 devstack sudo[101842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.info
Nov 05 12:04:58 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:58 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.info" returned: 0 in 0.356s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:58 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.info is being set with open permissions: ugo+rw
Nov 05 12:04:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:58 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.info
Nov 05 12:04:58 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:59 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.info" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d20cc0a9-56a0-4d6e-bcf0-0e7d53b1911d tempest-VolumeDependencyTests-678576538 None] Create snapshot completed successfully
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Flow 'volume_create_manager' (78507f0f-abe7-4794-847b-4536f3acf193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7064dffc-ea2c-4256-841c-88656f678be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7064dffc-ea2c-4256-841c-88656f678be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1499323103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c076b60f-2340-4d01-b998-6b5d39a6596d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2be037f0e94b2085f72f4af108198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7170cc8f-e770-4cbd-8bc7-25358519f4bc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:00Z,use_quota=True,user_id='0e6554677619453fb11a49ffe83abcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d501fda-9f9f-4906-8084-ac399f262b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d501fda-9f9f-4906-8084-ac399f262b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e834e23-3f4f-43a7-a01b-bf2b2f88c91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e834e23-3f4f-43a7-a01b-bf2b2f88c91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c076b60f-2340-4d01-b998-6b5d39a6596d', 'volume_name': 'volume-c076b60f-2340-4d01-b998-6b5d39a6596d', 'volume_size': 1, 'snapshot_id': '7170cc8f-e770-4cbd-8bc7-25358519f4bc'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e87108-14c1-4453-a748-8713f3ac27bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e87108-14c1-4453-a748-8713f3ac27bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b159850-d660-4f34-8760-8c302566dd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Volume c076b60f-2340-4d01-b998-6b5d39a6596d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c076b60f-2340-4d01-b998-6b5d39a6596d', 'volume_size': 1, 'snapshot_id': '7170cc8f-e770-4cbd-8bc7-25358519f4bc'}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-quobyte-7170cc8f-e770-4cbd-8bc7-25358519f4bc-c076b60f-2340-4d01-b998-6b5d39a6596d" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-7170cc8f-e770-4cbd-8bc7-25358519f4bc-c076b60f-2340-4d01-b998-6b5d39a6596d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Creating volume c076b60f-2340-4d01-b998-6b5d39a6596d from snapshot 7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-quobyte-c076b60f-2340-4d01-b998-6b5d39a6596d" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-c076b60f-2340-4d01-b998-6b5d39a6596d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] snapshot: 7170cc8f-e770-4cbd-8bc7-25358519f4bc, volume: c076b60f-2340-4d01-b998-6b5d39a6596d,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af4371-d768-44f6-bfac-bccb8d8e1264]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:00 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc
Nov 05 12:05:00 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:01 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc" returned: 0 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d54ff49-db5f-4cfa-84af-c11e15b1065c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:01 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194
Nov 05 12:05:01 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:01 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" returned: 0 in 0.484s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:05:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:01 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d
Nov 05 12:05:01 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:10 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:05:10 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:05:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Acquiring lock "cinder-5a720f9e-0a52-4174-a4db-b76a7c156676-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Lock "cinder-5a720f9e-0a52-4174-a4db-b76a7c156676-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Acquiring lock "cinder-quobyte-5a720f9e-0a52-4174-a4db-b76a7c156676" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Lock "cinder-quobyte-5a720f9e-0a52-4174-a4db-b76a7c156676" acquired by "delete_volume" :: waited 0.059s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a7ce92-a000-46cc-a5ad-f487e328280e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:11 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676
Nov 05 12:05:11 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:11 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d" returned: 0 in 10.128s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194, size 1024.00 MB, duration 10.13 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:05:11 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Converted 1024.00 MB image at 101.08 MB/s
Nov 05 12:05:11 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d is being set with open permissions: ugo+rw
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:11 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d
Nov 05 12:05:11 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:11 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676" returned: 0 in 0.712s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:12 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676
Nov 05 12:05:12 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:12 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-c076b60f-2340-4d01-b998-6b5d39a6596d" released by "_copy_volume_from_snapshot" :: held 11.506s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-7170cc8f-e770-4cbd-8bc7-25358519f4bc-c076b60f-2340-4d01-b998-6b5d39a6596d" released by "_create_volume_from_snapshot" :: held 11.582s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.601s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b159850-d660-4f34-8760-8c302566dd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c076b60f-2340-4d01-b998-6b5d39a6596d', 'volume_size': 1, 'snapshot_id': '7170cc8f-e770-4cbd-8bc7-25358519f4bc'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb02554-6917-4f11-9333-c906730a23a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Volume volume-c076b60f-2340-4d01-b998-6b5d39a6596d (c076b60f-2340-4d01-b998-6b5d39a6596d): created successfully
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb02554-6917-4f11-9333-c906730a23a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Flow 'volume_create_manager' (78507f0f-abe7-4794-847b-4536f3acf193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b7232889-d7be-464a-9b28-e7f7ead48983 tempest-VolumeDependencyTests-678576538 None] Created volume successfully.
Nov 05 12:05:12 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-5a720f9e-0a52-4174-a4db-b76a7c156676" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Lock "cinder-quobyte-5a720f9e-0a52-4174-a4db-b76a7c156676" released by "delete_volume" :: held 1.178s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Created reservations ['0077df5d-f3af-4c07-8faf-f5442819b5fd', 'df15bdbc-353a-456b-86c8-79d0d63c8ca3', '14eac495-ed89-4749-b216-d48aad1de9e1', '773b80e4-78d8-4e9c-9e59-ebd1f3d9e699'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:12 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:12 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:12 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Deleted volume successfully.
Nov 05 12:05:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9317bbfc-6d49-4845-951c-466681bf8edb tempest-VolumesNegativeTest-622688377 None] Lock "cinder-5a720f9e-0a52-4174-a4db-b76a7c156676-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-7170cc8f-e770-4cbd-8bc7-25358519f4bc-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-7170cc8f-e770-4cbd-8bc7-25358519f4bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-quobyte-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-quobyte-7170cc8f-e770-4cbd-8bc7-25358519f4bc" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (c047ee43-ff08-4f74-9691-55bf67087881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7e0d0d-2c1a-431a-a363-bd46845d3cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-7170cc8f-e770-4cbd-8bc7-25358519f4bc" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Deleting offline snapshot 7170cc8f-e770-4cbd-8bc7-25358519f4bc of volume 8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] snapshot_file for this snap is: volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7e0d0d-2c1a-431a-a363-bd46845d3cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85336628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37ea726-8d8e-4b14-9177-9f04467f6a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:13Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b633241-8fa9-4f13-a679-14b42fb17b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b633241-8fa9-4f13-a679-14b42fb17b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b1a93-3c3e-4dc4-b037-70cd62aa5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b1a93-3c3e-4dc4-b037-70cd62aa5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37ea726-8d8e-4b14-9177-9f04467f6a85', 'volume_name': 'volume-a37ea726-8d8e-4b14-9177-9f04467f6a85', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7696fde-f941-4849-866e-8724a5cb9a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7696fde-f941-4849-866e-8724a5cb9a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94164b7-1c21-46d7-8aea-6496ba817ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Volume a37ea726-8d8e-4b14-9177-9f04467f6a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37ea726-8d8e-4b14-9177-9f04467f6a85', 'volume_size': 1}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85336628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37ea726-8d8e-4b14-9177-9f04467f6a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:13Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Creating volume a37ea726-8d8e-4b14-9177-9f04467f6a85 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66d0431-92eb-4428-acd1-31d0e794a403]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:13 devstack sudo[102018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85 1073741824
Nov 05 12:05:13 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:13 devstack sudo[102019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc
Nov 05 12:05:13 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:13 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b643f2-5585-457b-82c0-9e4560e526a6]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:13 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85 1073741824" returned: 0 in 0.534s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:13 devstack sudo[102032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85
Nov 05 12:05:13 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:13 devstack sudo[102031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194
Nov 05 12:05:13 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:14 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94164b7-1c21-46d7-8aea-6496ba817ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37ea726-8d8e-4b14-9177-9f04467f6a85', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef57395-e6b2-46b0-9557-49cf9932800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Volume volume-a37ea726-8d8e-4b14-9177-9f04467f6a85 (a37ea726-8d8e-4b14-9177-9f04467f6a85): created successfully
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef57395-e6b2-46b0-9557-49cf9932800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (c047ee43-ff08-4f74-9691-55bf67087881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f8d54b43-2f22-4651-a023-f29676ed5771 tempest-VolumesActionsTest-2033923486 None] Created volume successfully.
Nov 05 12:05:14 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" returned: 0 in 0.684s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:14 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc
Nov 05 12:05:14 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:14 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc" returned: 0 in 0.370s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:14 devstack sudo[102044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc
Nov 05 12:05:14 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:15 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194.7170cc8f-e770-4cbd-8bc7-25358519f4bc" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-7170cc8f-e770-4cbd-8bc7-25358519f4bc" released by "_delete_snapshot" :: held 1.958s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" released by "delete_snapshot" :: held 2.023s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Created reservations ['4aba90c0-0c13-4e2a-9b44-dd2d0bba9046', 'eab961eb-1075-43e6-bc29-4157cefd15e4', '48fa8ccc-7455-44d2-bf57-9d8dcf8dbfcc', '39bbc360-3c8f-4104-9d85-1685204ea518'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b86868d-6204-45b2-9323-cf4df5850988 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85" by "attach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b86868d-6204-45b2-9323-cf4df5850988 tempest-VolumesActionsTest-2033923486 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85" acquired by "attach_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Delete snapshot completed successfully.
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc335197-c409-4593-b18e-5bebb68ab5f3 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-7170cc8f-e770-4cbd-8bc7-25358519f4bc-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9b86868d-6204-45b2-9323-cf4df5850988 tempest-VolumesActionsTest-2033923486 None] Attaching volume a37ea726-8d8e-4b14-9177-9f04467f6a85 to instance 8e8e1875-a215-4219-bf95-97a45ffe917c at mountpoint /dev/vdb on host None.
Nov 05 12:05:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9b86868d-6204-45b2-9323-cf4df5850988 tempest-VolumesActionsTest-2033923486 None] Attach volume completed successfully.
Nov 05 12:05:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9b86868d-6204-45b2-9323-cf4df5850988 tempest-VolumesActionsTest-2033923486 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85" released by "attach_volume" :: held 0.157s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-8304f12a-7d3b-4f30-93ca-b7eefd6f4194-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Lock "cinder-8304f12a-7d3b-4f30-93ca-b7eefd6f4194-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-quobyte-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e20206-1ce1-4618-99fb-a8899d3b243b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-51dc24bf-0cf8-404e-92e3-278c56910467 tempest-VolumesActionsTest-1381239624 None] Terminate volume connection completed successfully.
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-51dc24bf-0cf8-404e-92e3-278c56910467 tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:16 devstack sudo[102047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194
Nov 05 12:05:16 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-51dc24bf-0cf8-404e-92e3-278c56910467 tempest-VolumesActionsTest-1381239624 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-51dc24bf-0cf8-404e-92e3-278c56910467 tempest-VolumesActionsTest-1381239624 None] Detaching volume a37ea726-8d8e-4b14-9177-9f04467f6a85 from instance 8e8e1875-a215-4219-bf95-97a45ffe917c.
Nov 05 12:05:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-51dc24bf-0cf8-404e-92e3-278c56910467 tempest-VolumesActionsTest-1381239624 None] Detach volume completed successfully.
Nov 05 12:05:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-51dc24bf-0cf8-404e-92e3-278c56910467 tempest-VolumesActionsTest-1381239624 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:17 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" returned: 0 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:17 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194
Nov 05 12:05:17 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-38277f9c-9342-42fe-8791-53b665e5c0df tempest-VolumesActionsTest-2033923486 None] Acquiring lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-38277f9c-9342-42fe-8791-53b665e5c0df tempest-VolumesActionsTest-2033923486 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-38277f9c-9342-42fe-8791-53b665e5c0df tempest-VolumesActionsTest-2033923486 None] Volume detach called, but volume not attached.
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-38277f9c-9342-42fe-8791-53b665e5c0df tempest-VolumesActionsTest-2033923486 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Acquiring lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:17 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" returned: 0 in 0.444s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Acquiring lock "cinder-quobyte-a37ea726-8d8e-4b14-9177-9f04467f6a85" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-8304f12a-7d3b-4f30-93ca-b7eefd6f4194" released by "delete_volume" :: held 1.036s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Lock "cinder-quobyte-a37ea726-8d8e-4b14-9177-9f04467f6a85" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd958cd-1249-4b5e-8441-6c89ea207f2f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Created reservations ['ce5ce8ac-3155-4cb9-9b19-a240aebaef9a', '23ca9014-1e21-490b-9674-d2f786ef54ff', 'fa76ee48-39f6-49c5-9b39-bfbedf9c313d', 'e73097f6-f1ea-4be7-9691-c2bfab716406'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:17 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85
Nov 05 12:05:17 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:17 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:17 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:18 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Deleted volume successfully.
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9f6d75e6-8255-4af4-8915-999354a5dfaf tempest-VolumeDependencyTests-678576538 None] Lock "cinder-8304f12a-7d3b-4f30-93ca-b7eefd6f4194-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:18 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85" returned: 0 in 0.590s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:18 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85
Nov 05 12:05:18 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:18 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a37ea726-8d8e-4b14-9177-9f04467f6a85" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Lock "cinder-quobyte-a37ea726-8d8e-4b14-9177-9f04467f6a85" released by "delete_volume" :: held 0.964s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Created reservations ['8d79edda-6442-41e3-91f4-c671fced2677', '6cb9f8bb-9db2-42f1-9ba4-b129ab8c6367', 'ff44975d-8657-4783-a25c-903bb286b34a', 'c061a656-4ff3-40d0-8447-6f4aa579e979'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-c076b60f-2340-4d01-b998-6b5d39a6596d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-c076b60f-2340-4d01-b998-6b5d39a6596d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "cinder-quobyte-c076b60f-2340-4d01-b998-6b5d39a6596d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-c076b60f-2340-4d01-b998-6b5d39a6596d" acquired by "delete_volume" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:18 devstack sudo[102067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:18 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91061d19-8cdd-49e7-b6d5-147f4355947c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d
Nov 05 12:05:19 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:19 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Deleted volume successfully.
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f87adeaa-789d-4e38-bc0b-1d5a8ba2390e tempest-VolumesActionsTest-2033923486 None] Lock "cinder-a37ea726-8d8e-4b14-9177-9f04467f6a85-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:19 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d" returned: 0 in 0.451s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d
Nov 05 12:05:19 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:19 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c076b60f-2340-4d01-b998-6b5d39a6596d" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-quobyte-c076b60f-2340-4d01-b998-6b5d39a6596d" released by "delete_volume" :: held 0.804s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Created reservations ['3538c62b-0cc2-4c0e-88cc-7232a0f4c885', '95d55812-7bbc-4106-ad1c-abf960038f5c', '430698f8-3ac7-4a91-977d-0e54db0a7850', '3581f9f5-8105-4efc-b683-7b03ed59783e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:19 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:20 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:20 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Deleted volume successfully.
Nov 05 12:05:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dca39e84-5a56-419a-a286-3e1a9e1bb278 tempest-VolumeDependencyTests-678576538 None] Lock "cinder-c076b60f-2340-4d01-b998-6b5d39a6596d-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (4e0af4c4-26cf-46a9-9bdb-3b50667fca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f54b7a9-304e-44d7-9bf5-fc7a39588cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f54b7a9-304e-44d7-9bf5-fc7a39588cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-191149178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0535eaf-0a32-43b0-89d8-e4231b4dd1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:24Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0f98ce-c83c-4df9-95a4-4d643be54a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0f98ce-c83c-4df9-95a4-4d643be54a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c94859-ab86-40e0-9b7c-76a0dc9440a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c94859-ab86-40e0-9b7c-76a0dc9440a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0535eaf-0a32-43b0-89d8-e4231b4dd1f3', 'volume_name': 'volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e4e46-e7e8-4469-b27c-48fb789749ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e4e46-e7e8-4469-b27c-48fb789749ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe3b60e-ff48-409b-a107-f76cfbcaa7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Volume f0535eaf-0a32-43b0-89d8-e4231b4dd1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3', 'volume_size': 1}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-191149178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0535eaf-0a32-43b0-89d8-e4231b4dd1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:24Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Creating volume f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:23 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:23 devstack sudo[102105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 1073741824
Nov 05 12:05:23 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:24 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 1073741824" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:24 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3
Nov 05 12:05:24 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:24 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3" returned: 0 in 0.413s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe3b60e-ff48-409b-a107-f76cfbcaa7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfe2482-692e-40bf-b943-19b31a47a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Volume volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 (f0535eaf-0a32-43b0-89d8-e4231b4dd1f3): created successfully
Nov 05 12:05:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfe2482-692e-40bf-b943-19b31a47a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (4e0af4c4-26cf-46a9-9bdb-3b50667fca5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-27315957-51f1-4f60-9c62-7988a465fdb3 tempest-VolumesActionsTest-2033923486 None] Created volume successfully.
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Lock "cinder-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-quobyte-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a112fc-f7bb-4c1d-850f-58348f84c992]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:26 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3
Nov 05 12:05:26 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:26 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3" returned: 0 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:26 devstack sudo[102120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3
Nov 05 12:05:26 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:26 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3" released by "delete_volume" :: held 0.796s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Created reservations ['a211542e-a54d-45b2-a689-496d3094b017', 'a2c175ce-af80-44f7-b084-de58222efa2a', '049f6b6b-1bda-4690-9703-9492a62c5047', '3dfd4fd7-15b0-47b8-9310-02cc6cdf7a88'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:27 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:27 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:27 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.370s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Deleted volume successfully.
Nov 05 12:05:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-152e039f-f9c5-44ba-8d4c-de3db42db182 tempest-VolumesActionsTest-1381239624 None] Lock "cinder-f0535eaf-0a32-43b0-89d8-e4231b4dd1f3-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (6ecb5651-0d73-4e0d-a885-531e0790b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3320cd-c2c1-4fdd-b135-85698a6888b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3320cd-c2c1-4fdd-b135-85698a6888b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1617159971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73e5b28-9934-4258-a89e-9822f82a5e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:28Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e42d9a-97f0-41c7-bdc3-8407bba89f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e42d9a-97f0-41c7-bdc3-8407bba89f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4c2343-a432-4c72-a4cd-4581ec208f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4c2343-a432-4c72-a4cd-4581ec208f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a73e5b28-9934-4258-a89e-9822f82a5e57', 'volume_name': 'volume-a73e5b28-9934-4258-a89e-9822f82a5e57', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d52dcfe-e7fb-45fd-89ab-1c645d9d2ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d52dcfe-e7fb-45fd-89ab-1c645d9d2ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d655292c-7d38-4111-ad6a-21d96dbd0650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Volume a73e5b28-9934-4258-a89e-9822f82a5e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a73e5b28-9934-4258-a89e-9822f82a5e57', 'volume_size': 1}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1617159971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73e5b28-9934-4258-a89e-9822f82a5e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:28Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Creating volume a73e5b28-9934-4258-a89e-9822f82a5e57 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:28 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:28 devstack sudo[102126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57 1073741824
Nov 05 12:05:28 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:28 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57 1073741824" returned: 0 in 0.675s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:28 devstack sudo[102134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57
Nov 05 12:05:28 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:29 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d655292c-7d38-4111-ad6a-21d96dbd0650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73e5b28-9934-4258-a89e-9822f82a5e57', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6e1a28-807e-47e5-be50-5bf679cb8fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Volume volume-a73e5b28-9934-4258-a89e-9822f82a5e57 (a73e5b28-9934-4258-a89e-9822f82a5e57): created successfully
Nov 05 12:05:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6e1a28-807e-47e5-be50-5bf679cb8fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (6ecb5651-0d73-4e0d-a885-531e0790b600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-316787e0-7232-434e-a16a-61e9678b80ff tempest-VolumesActionsTest-2033923486 None] Created volume successfully.
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (32cedbf1-3554-4f94-8aae-8f2c943a65cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab3bded-9ff1-4682-9709-3349ce662a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab3bded-9ff1-4682-9709-3349ce662a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-878607432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e504e8-0109-4741-a77b-a6b8400ada87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:30Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19b685d-bd5e-425f-b098-1b8f6ba2bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19b685d-bd5e-425f-b098-1b8f6ba2bf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c747de90-15e2-4d91-93a4-939ec309db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c747de90-15e2-4d91-93a4-939ec309db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e504e8-0109-4741-a77b-a6b8400ada87', 'volume_name': 'volume-f3e504e8-0109-4741-a77b-a6b8400ada87', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6612476e-437a-4ed6-bdd8-a0034cffe680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6612476e-437a-4ed6-bdd8-a0034cffe680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56ce8c9-3846-4dce-8626-5990303cd7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume f3e504e8-0109-4741-a77b-a6b8400ada87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e504e8-0109-4741-a77b-a6b8400ada87', 'volume_size': 1}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-878607432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e504e8-0109-4741-a77b-a6b8400ada87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:30Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Creating volume f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:30 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-a73e5b28-9934-4258-a89e-9822f82a5e57-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:30 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 1073741824
Nov 05 12:05:30 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Lock "cinder-a73e5b28-9934-4258-a89e-9822f82a5e57-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-quobyte-a73e5b28-9934-4258-a89e-9822f82a5e57" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-a73e5b28-9934-4258-a89e-9822f82a5e57" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90cc774-aaac-4ad5-b0c8-65ada9cb9762]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:30 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57
Nov 05 12:05:30 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:30 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 1073741824" returned: 0 in 0.496s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:30 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:30 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:30 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:30 devstack sudo[102149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57
Nov 05 12:05:30 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:31 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56ce8c9-3846-4dce-8626-5990303cd7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e504e8-0109-4741-a77b-a6b8400ada87', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7147e54f-7673-463c-9174-5de4f04f3983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:31 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume volume-f3e504e8-0109-4741-a77b-a6b8400ada87 (f3e504e8-0109-4741-a77b-a6b8400ada87): created successfully
Nov 05 12:05:31 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7147e54f-7673-463c-9174-5de4f04f3983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (32cedbf1-3554-4f94-8aae-8f2c943a65cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a73e5b28-9934-4258-a89e-9822f82a5e57" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-a73e5b28-9934-4258-a89e-9822f82a5e57" released by "delete_volume" :: held 0.747s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-00413550-852e-48d5-a796-32d9f342e547 tempest-VolumesSnapshotTestJSON-1940732208 None] Created volume successfully.
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Created reservations ['1c32b93a-f3bf-479d-98e4-509043f07886', '10621919-fb0e-431c-8e88-41e5e2590f91', 'b979abd3-c7cf-47e9-b5db-ff54e374d77c', '3b6c7b12-831c-4155-9ffc-346939d4f088'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:31 devstack sudo[102153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:31 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:31 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Deleted volume successfully.
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Creating offline snapshot e78eb791-7a3b-469f-9ced-d5df5f5e11bf of volume f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6aefec01-8db5-4c1d-810c-eead24c5380a tempest-VolumesActionsTest-1381239624 None] Lock "cinder-a73e5b28-9934-4258-a89e-9822f82a5e57-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c51fc3-ded8-453c-a7e4-b5ddcb4ffb82]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:31 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87
Nov 05 12:05:31 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:32 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:32 devstack sudo[102161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf 1G
Nov 05 12:05:32 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (a6a0723a-3c00-4532-b220-e46b8db74fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d071fc0-0ced-42ba-970c-73f37f159369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d071fc0-0ced-42ba-970c-73f37f159369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1946098709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d149247-6748-4b40-9b0e-4cbe3776ad0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:32Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9753ac1-a90f-4f41-947d-a751a8c3f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9753ac1-a90f-4f41-947d-a751a8c3f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfe1fbb-c35e-4569-a1c7-5db8b5f6e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfe1fbb-c35e-4569-a1c7-5db8b5f6e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d149247-6748-4b40-9b0e-4cbe3776ad0e', 'volume_name': 'volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72b204c-267e-4a9f-9b65-9bf25008ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72b204c-267e-4a9f-9b65-9bf25008ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d521b87-1acf-451b-96dc-74f6a08eca3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Volume 7d149247-6748-4b40-9b0e-4cbe3776ad0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e', 'volume_size': 1}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:32 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf 1G" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e504e8-0109-4741-a77b-a6b8400ada87 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:32 devstack sudo[102166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e504e8-0109-4741-a77b-a6b8400ada87 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf
Nov 05 12:05:32 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:32 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e504e8-0109-4741-a77b-a6b8400ada87 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:32 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf is being set with open permissions: ugo+rw
Nov 05 12:05:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:32 devstack sudo[102171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf
Nov 05 12:05:32 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:33 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:33 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.info
Nov 05 12:05:33 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:33 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.info" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:33 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.info is being set with open permissions: ugo+rw
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:33 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.info
Nov 05 12:05:33 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:33 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.info" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1946098709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d149247-6748-4b40-9b0e-4cbe3776ad0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:32Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Creating volume 7d149247-6748-4b40-9b0e-4cbe3776ad0e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:33 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:33 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e 1073741824
Nov 05 12:05:33 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a5131f91-6645-46f3-a533-b66d798f9a52 tempest-VolumesSnapshotTestJSON-1940732208 None] Create snapshot completed successfully
Nov 05 12:05:34 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e 1073741824" returned: 0 in 0.444s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:34 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e
Nov 05 12:05:34 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:34 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d521b87-1acf-451b-96dc-74f6a08eca3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1ea5aa-04c0-44b5-b7b4-2b70663dd75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Volume volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e (7d149247-6748-4b40-9b0e-4cbe3776ad0e): created successfully
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1ea5aa-04c0-44b5-b7b4-2b70663dd75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (a6a0723a-3c00-4532-b220-e46b8db74fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8834926d-c3f7-4ecd-abdc-8e671f634232 tempest-VolumesActionsTest-2033923486 None] Created volume successfully.
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-e78eb791-7a3b-469f-9ced-d5df5f5e11bf-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-e78eb791-7a3b-469f-9ced-d5df5f5e11bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-f3e504e8-0109-4741-a77b-a6b8400ada87" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-f3e504e8-0109-4741-a77b-a6b8400ada87" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-e78eb791-7a3b-469f-9ced-d5df5f5e11bf" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-e78eb791-7a3b-469f-9ced-d5df5f5e11bf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Deleting offline snapshot e78eb791-7a3b-469f-9ced-d5df5f5e11bf of volume f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] snapshot_file for this snap is: volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e708aa6-3f94-403b-b380-6aee4f8828ab]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:35 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf
Nov 05 12:05:35 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:35 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e504e8-0109-4741-a77b-a6b8400ada87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-7d149247-6748-4b40-9b0e-4cbe3776ad0e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ae1827-1c55-4278-acb5-ba46146ab48d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Lock "cinder-7d149247-6748-4b40-9b0e-4cbe3776ad0e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-quobyte-7d149247-6748-4b40-9b0e-4cbe3776ad0e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-7d149247-6748-4b40-9b0e-4cbe3776ad0e" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:35 devstack sudo[102195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87
Nov 05 12:05:35 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a087fa-6827-47d1-b51c-c0d885aee992]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:35 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e
Nov 05 12:05:35 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:35 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:35 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf
Nov 05 12:05:35 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:36 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e" returned: 0 in 0.409s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:36 devstack sudo[102207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e
Nov 05 12:05:36 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:36 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:36 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf
Nov 05 12:05:36 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:36 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d149247-6748-4b40-9b0e-4cbe3776ad0e" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-7d149247-6748-4b40-9b0e-4cbe3776ad0e" released by "delete_volume" :: held 0.742s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Created reservations ['c273567a-989c-4716-8c6f-a2dbb048a34a', '57b4b73a-56bd-49df-bf99-67f6d14ebe1f', '19dd16f2-02f6-4770-b84d-e171cf76e9bc', 'b6cdeb6e-e6f1-47a4-865b-beef3e529897'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:36 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87.e78eb791-7a3b-469f-9ced-d5df5f5e11bf" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:36 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:36 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-e78eb791-7a3b-469f-9ced-d5df5f5e11bf" released by "_delete_snapshot" :: held 1.667s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-f3e504e8-0109-4741-a77b-a6b8400ada87" released by "delete_snapshot" :: held 1.694s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['3b1bad43-9bd4-4049-8829-ad50c48461e7', '715d955f-bb02-4334-9490-a9ffae1d9f0b', '9ea83e67-071b-4827-a486-cf492d7c7e8d', '4abcc5ad-d00d-4f99-9159-357fc4cece72'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Delete snapshot completed successfully.
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-216ae57b-9212-4ba2-a9ca-db8dac9c0d69 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-e78eb791-7a3b-469f-9ced-d5df5f5e11bf-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:36 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Deleted volume successfully.
Nov 05 12:05:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ef3b61fe-5854-4e24-92d5-a0d722233b6b tempest-VolumesActionsTest-1381239624 None] Lock "cinder-7d149247-6748-4b40-9b0e-4cbe3776ad0e-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (220ab7c9-7f5e-4e8d-b6ea-d1c2091ac099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6577788b-2f43-464e-8c6b-71b4c64e0c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6577788b-2f43-464e-8c6b-71b4c64e0c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-441937550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc8999-39c0-4079-8a3f-6e130b6f0e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:37Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2db9891-52e1-4c34-9032-50b025eafe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2db9891-52e1-4c34-9032-50b025eafe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4dafd4-6949-4a0d-be76-989408c84c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4dafd4-6949-4a0d-be76-989408c84c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3dc8999-39c0-4079-8a3f-6e130b6f0e66', 'volume_name': 'volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3e6f6a-9954-4073-b198-89435e11d6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3e6f6a-9954-4073-b198-89435e11d6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad873d5-8b13-402b-93dc-a8d9fb07adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Volume a3dc8999-39c0-4079-8a3f-6e130b6f0e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66', 'volume_size': 1}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-441937550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc8999-39c0-4079-8a3f-6e130b6f0e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:37Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Creating volume a3dc8999-39c0-4079-8a3f-6e130b6f0e66 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:37 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:37 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66 1073741824
Nov 05 12:05:37 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (32a46b87-f24b-44de-810c-febb6754d5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313f66c0-e1a8-4059-bd76-2cdef0ffae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313f66c0-e1a8-4059-bd76-2cdef0ffae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1914289112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c5e095-e203-4490-996b-e5e0e527a2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:38Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b1813-f974-47e7-b432-a4aca1d9acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b1813-f974-47e7-b432-a4aca1d9acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd385f-2c15-4eff-912b-187fd1ae5697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd385f-2c15-4eff-912b-187fd1ae5697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c5e095-e203-4490-996b-e5e0e527a2f9', 'volume_name': 'volume-a4c5e095-e203-4490-996b-e5e0e527a2f9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc4419d-ca1b-4f4b-9101-b316457d4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc4419d-ca1b-4f4b-9101-b316457d4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4f0ffb-0750-4e8a-abb9-eae830b94a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume a4c5e095-e203-4490-996b-e5e0e527a2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c5e095-e203-4490-996b-e5e0e527a2f9', 'volume_size': 1}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:37 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66 1073741824" returned: 0 in 0.506s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:37 devstack sudo[102225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66
Nov 05 12:05:37 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:38 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1914289112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c5e095-e203-4490-996b-e5e0e527a2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:38Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Creating volume a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:38 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad873d5-8b13-402b-93dc-a8d9fb07adb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:38 devstack sudo[102228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 1073741824
Nov 05 12:05:38 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b04985f-2e8d-42f4-885d-2e0f976460d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Volume volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66 (a3dc8999-39c0-4079-8a3f-6e130b6f0e66): created successfully
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b04985f-2e8d-42f4-885d-2e0f976460d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (220ab7c9-7f5e-4e8d-b6ea-d1c2091ac099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-31f79a71-d835-44d7-88aa-70a6f26d3cad tempest-VolumesActionsTest-2033923486 None] Created volume successfully.
Nov 05 12:05:38 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 1073741824" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:38 devstack sudo[102234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9
Nov 05 12:05:38 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:38 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9" returned: 0 in 0.239s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4f0ffb-0750-4e8a-abb9-eae830b94a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c5e095-e203-4490-996b-e5e0e527a2f9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd51352-ce11-4ca2-b6f5-b9cc7f3ba407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 (a4c5e095-e203-4490-996b-e5e0e527a2f9): created successfully
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd51352-ce11-4ca2-b6f5-b9cc7f3ba407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (32a46b87-f24b-44de-810c-febb6754d5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-52a3cd4d-215f-45f3-9ac0-644da16bdf89 tempest-VolumesSnapshotTestJSON-1940732208 None] Created volume successfully.
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-a3dc8999-39c0-4079-8a3f-6e130b6f0e66-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Lock "cinder-a3dc8999-39c0-4079-8a3f-6e130b6f0e66-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Acquiring lock "cinder-quobyte-a3dc8999-39c0-4079-8a3f-6e130b6f0e66" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-a3dc8999-39c0-4079-8a3f-6e130b6f0e66" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d9c0ff-133c-47f8-8ef3-3ca96b5f5f92]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:39 devstack sudo[102237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66
Nov 05 12:05:39 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Creating offline snapshot a4c7c90f-8028-4481-9c4c-ab06e6e2e184 of volume a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:05:39 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993e127-c940-4155-9f7b-b2345e625d82]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:39 devstack sudo[102242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66
Nov 05 12:05:39 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:40 devstack sudo[102243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9
Nov 05 12:05:40 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:40 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a3dc8999-39c0-4079-8a3f-6e130b6f0e66" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Lock "cinder-quobyte-a3dc8999-39c0-4079-8a3f-6e130b6f0e66" released by "delete_volume" :: held 0.683s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Created reservations ['9bd20d64-cb26-455e-98cf-f384300808a9', 'f9d6fc2a-1e7b-44bb-a945-f25c07371055', 'd9abc91b-6d1a-4231-aa40-16a43cafcb2a', 'd7751140-8b2e-4c82-b25d-a268cc6bfe5f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:40 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:40 devstack sudo[102250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:40 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:40 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 1G
Nov 05 12:05:40 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:40 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Deleted volume successfully.
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-474e1e24-40a6-4293-b406-f69be98b885d tempest-VolumesActionsTest-1381239624 None] Lock "cinder-a3dc8999-39c0-4079-8a3f-6e130b6f0e66-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:40 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 1G" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:40 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184
Nov 05 12:05:40 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 is being set with open permissions: ugo+rw
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:41 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184
Nov 05 12:05:41 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (cb7c247a-a4c1-4a3c-a088-78be814fe04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749e3a8a-d63b-44d9-9bb0-4636071c932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749e3a8a-d63b-44d9-9bb0-4636071c932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1035507179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06e9254-0da4-4501-800a-871e8fc862c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:41Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5976c3d8-ab0e-47be-b938-da60d465ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5976c3d8-ab0e-47be-b938-da60d465ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93a3bee-3670-4a84-ab33-f36ed73268f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93a3bee-3670-4a84-ab33-f36ed73268f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06e9254-0da4-4501-800a-871e8fc862c0', 'volume_name': 'volume-b06e9254-0da4-4501-800a-871e8fc862c0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c194d1cb-c810-4a0a-a0a0-6cc13a518264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c194d1cb-c810-4a0a-a0a0-6cc13a518264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d9fec7-ad5c-4d6d-a4a8-37102109e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Volume b06e9254-0da4-4501-800a-871e8fc862c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06e9254-0da4-4501-800a-871e8fc862c0', 'volume_size': 1}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:41 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:41 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.info
Nov 05 12:05:41 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.info" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.info is being set with open permissions: ugo+rw
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:41 devstack sudo[102275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.info
Nov 05 12:05:41 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.info" returned: 0 in 0.235s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1035507179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06e9254-0da4-4501-800a-871e8fc862c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a923e18a20a43438fd9e9f2a277ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:41Z,use_quota=True,user_id='a47030dba76a4dafacb72e81123f2cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Creating volume b06e9254-0da4-4501-800a-871e8fc862c0 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:41 devstack sudo[102278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0 1073741824
Nov 05 12:05:41 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b54bc08a-e0a6-476c-afa5-c873aa48c311 tempest-VolumesSnapshotTestJSON-1940732208 None] Create snapshot completed successfully
Nov 05 12:05:42 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0 1073741824" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:42 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0
Nov 05 12:05:42 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:42 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d9fec7-ad5c-4d6d-a4a8-37102109e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06e9254-0da4-4501-800a-871e8fc862c0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d14bebf-d355-47df-86f3-49219e7f2399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Volume volume-b06e9254-0da4-4501-800a-871e8fc862c0 (b06e9254-0da4-4501-800a-871e8fc862c0): created successfully
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d14bebf-d355-47df-86f3-49219e7f2399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Flow 'volume_create_manager' (cb7c247a-a4c1-4a3c-a088-78be814fe04a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d5168a53-dd7b-4894-9be6-94d901bb4c3c tempest-VolumesActionsTest-2033923486 None] Created volume successfully.
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (ffa371f4-e3ec-4418-8de3-c4688765a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8448ab09-0cea-4ddb-add4-5320a97c91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8448ab09-0cea-4ddb-add4-5320a97c91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2025179964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469ee62f-9cd2-4efc-a94a-59c166bdf225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a4c7c90f-8028-4481-9c4c-ab06e6e2e184,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:44Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300ba2da-25f1-4cca-9874-64de4b6fc94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300ba2da-25f1-4cca-9874-64de4b6fc94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d134b876-f2f9-425d-b503-23cf085744eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d134b876-f2f9-425d-b503-23cf085744eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '469ee62f-9cd2-4efc-a94a-59c166bdf225', 'volume_name': 'volume-469ee62f-9cd2-4efc-a94a-59c166bdf225', 'volume_size': 2, 'snapshot_id': 'a4c7c90f-8028-4481-9c4c-ab06e6e2e184'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4a292c-598a-45f8-82ff-b5edbf867b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4a292c-598a-45f8-82ff-b5edbf867b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190b78fe-209d-47f3-a09f-f25662d319c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Volume 469ee62f-9cd2-4efc-a94a-59c166bdf225: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-469ee62f-9cd2-4efc-a94a-59c166bdf225', 'volume_size': 2, 'snapshot_id': 'a4c7c90f-8028-4481-9c4c-ab06e6e2e184'}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-a4c7c90f-8028-4481-9c4c-ab06e6e2e184-469ee62f-9cd2-4efc-a94a-59c166bdf225" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c7c90f-8028-4481-9c4c-ab06e6e2e184-469ee62f-9cd2-4efc-a94a-59c166bdf225" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Creating volume 469ee62f-9cd2-4efc-a94a-59c166bdf225 from snapshot a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-469ee62f-9cd2-4efc-a94a-59c166bdf225" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-469ee62f-9cd2-4efc-a94a-59c166bdf225" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] snapshot: a4c7c90f-8028-4481-9c4c-ab06e6e2e184, volume: 469ee62f-9cd2-4efc-a94a-59c166bdf225,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6eef4d-bf0d-4913-bad4-7f1b73663a72]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "cinder-b06e9254-0da4-4501-800a-871e8fc862c0-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Lock "cinder-b06e9254-0da4-4501-800a-871e8fc862c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "cinder-quobyte-b06e9254-0da4-4501-800a-871e8fc862c0" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Lock "cinder-quobyte-b06e9254-0da4-4501-800a-871e8fc862c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:43 devstack sudo[102287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184
Nov 05 12:05:43 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921fc29-1f44-4949-8876-453e702c2036]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:44 devstack sudo[102289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0
Nov 05 12:05:44 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:44 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184" returned: 0 in 0.386s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c5e095-e203-4490-996b-e5e0e527a2f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[506dd253-ba4b-460f-8bc5-9f5f6d304a2a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:44 devstack sudo[102294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9
Nov 05 12:05:44 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:44 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:44 devstack sudo[102299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0
Nov 05 12:05:44 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:44 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b06e9254-0da4-4501-800a-871e8fc862c0" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Lock "cinder-quobyte-b06e9254-0da4-4501-800a-871e8fc862c0" released by "delete_volume" :: held 0.669s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:44 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:44 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225
Nov 05 12:05:44 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Created reservations ['0cc457eb-010d-4952-b53f-088b0df63389', 'dc37da43-28a9-4512-ac10-0da94cd28397', '6fb4eb09-cab6-4a41-b7e8-db6e890f25d9', 'c6994a3c-402b-42d8-b431-bb1292f6f635'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:44 devstack sudo[102308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:44 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:45 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Deleted volume successfully.
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13101610-2dd8-4bd8-b879-7dbe0f4de5a8 tempest-VolumesActionsTest-2033923486 None] Lock "cinder-b06e9254-0da4-4501-800a-871e8fc862c0-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:45 devstack sudo[102323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:45 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:45 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.565s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:05:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:05:51 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225" returned: 0 in 6.720s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:05:51 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Converted 1024.00 MB image at 152.36 MB/s
Nov 05 12:05:51 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 is being set with open permissions: ugo+rw
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:51 devstack sudo[102328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225
Nov 05 12:05:51 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:51 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225" returned: 0 in 0.252s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-469ee62f-9cd2-4efc-a94a-59c166bdf225" released by "_copy_volume_from_snapshot" :: held 7.839s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c7c90f-8028-4481-9c4c-ab06e6e2e184-469ee62f-9cd2-4efc-a94a-59c166bdf225" released by "_create_volume_from_snapshot" :: held 7.904s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.921s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190b78fe-209d-47f3-a09f-f25662d319c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469ee62f-9cd2-4efc-a94a-59c166bdf225', 'volume_size': 2, 'snapshot_id': 'a4c7c90f-8028-4481-9c4c-ab06e6e2e184'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56a5e4a-fdcd-4399-ba34-f3d16a3683a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Volume volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 (469ee62f-9cd2-4efc-a94a-59c166bdf225): created successfully
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56a5e4a-fdcd-4399-ba34-f3d16a3683a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (ffa371f4-e3ec-4418-8de3-c4688765a749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-14e92869-c84e-4ba5-abac-0adfc39f260d tempest-VolumesSnapshotTestJSON-1940732208 None] Created volume successfully.
Nov 05 12:05:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-469ee62f-9cd2-4efc-a94a-59c166bdf225-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-469ee62f-9cd2-4efc-a94a-59c166bdf225-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-469ee62f-9cd2-4efc-a94a-59c166bdf225" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-469ee62f-9cd2-4efc-a94a-59c166bdf225" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb57353-51bb-4896-a899-f42ae91220e9]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:52 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225
Nov 05 12:05:52 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:53 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:53 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225
Nov 05 12:05:53 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:53 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-469ee62f-9cd2-4efc-a94a-59c166bdf225" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-469ee62f-9cd2-4efc-a94a-59c166bdf225" released by "delete_volume" :: held 0.685s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['3ad84d9d-5de2-4a02-a857-cd4b660da3db', '22e7e3e2-5d4c-437b-890f-dbcd86919abd', 'de6aa3ca-4a45-4299-a41d-597fcb269b2c', 'eebebba0-0a40-44b1-a05e-5f03730b8c60'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:53 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:53 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-a4c7c90f-8028-4481-9c4c-ab06e6e2e184-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:53 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Deleted volume successfully.
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-a4c7c90f-8028-4481-9c4c-ab06e6e2e184-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-a4c5e095-e203-4490-996b-e5e0e527a2f9" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c5e095-e203-4490-996b-e5e0e527a2f9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-a4c7c90f-8028-4481-9c4c-ab06e6e2e184" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a7164b3f-4d22-4ad1-af87-28882394d5d3 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-469ee62f-9cd2-4efc-a94a-59c166bdf225-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c7c90f-8028-4481-9c4c-ab06e6e2e184" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Deleting offline snapshot a4c7c90f-8028-4481-9c4c-ab06e6e2e184 of volume a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] snapshot_file for this snap is: volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9cdd84-d23f-4bae-9a91-be1fd0a79b90]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:53 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184
Nov 05 12:05:53 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:54 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c5e095-e203-4490-996b-e5e0e527a2f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d960afed-c7b4-4633-a9c7-32bb67fd6aba]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:54 devstack sudo[102350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9
Nov 05 12:05:54 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:54 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9" returned: 0 in 0.562s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:54 devstack sudo[102355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184
Nov 05 12:05:54 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:55 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184" returned: 0 in 0.328s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:55 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184
Nov 05 12:05:55 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:55 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9.a4c7c90f-8028-4481-9c4c-ab06e6e2e184" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c7c90f-8028-4481-9c4c-ab06e6e2e184" released by "_delete_snapshot" :: held 1.661s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c5e095-e203-4490-996b-e5e0e527a2f9" released by "delete_snapshot" :: held 1.692s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['f5a16081-b776-4e31-9dcc-8eb6394f23c9', '30fdde2a-3976-40a5-b985-db334d113af6', 'cdec16d1-cb10-429e-94fc-083835659320', 'c954cf54-a628-41c4-ab3a-e91f3777965d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Delete snapshot completed successfully.
Nov 05 12:05:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c818fd98-aa0b-404c-867d-247327e539b9 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-a4c7c90f-8028-4481-9c4c-ab06e6e2e184-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-a4c5e095-e203-4490-996b-e5e0e527a2f9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-a4c5e095-e203-4490-996b-e5e0e527a2f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-a4c5e095-e203-4490-996b-e5e0e527a2f9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c5e095-e203-4490-996b-e5e0e527a2f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[717bf267-c0a1-4b73-85b9-aa42b750e6e1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:56 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9
Nov 05 12:05:56 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:56 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:56 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9
Nov 05 12:05:56 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:56 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a4c5e095-e203-4490-996b-e5e0e527a2f9" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-a4c5e095-e203-4490-996b-e5e0e527a2f9" released by "delete_volume" :: held 0.769s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['1753c104-99a5-4611-a7f0-06220cb79a92', '821cdf0a-304c-4dca-93a3-e029caae775c', 'bd2d53ab-34e1-45a5-93e5-2c9b55cd1325', '20c81d40-0201-4a57-96a6-94edf35804f3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:57 devstack sudo[102372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:05:57 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:57 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Deleted volume successfully.
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9221363-497f-45ea-bb83-f1d38be6d01b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-a4c5e095-e203-4490-996b-e5e0e527a2f9-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (83916455-9a73-4913-a7f8-ee307f3002d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731585a5-2e1e-40a2-9d00-ac253f5e5cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731585a5-2e1e-40a2-9d00-ac253f5e5cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1680726676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d911c47b-fe4d-4d84-8ba5-656a4b1b52a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:58Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06f538-1c88-4df5-b897-734d0a35d1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06f538-1c88-4df5-b897-734d0a35d1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9479ba37-dcc8-4a54-9950-b2bf0a6c2b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9479ba37-dcc8-4a54-9950-b2bf0a6c2b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd911c47b-fe4d-4d84-8ba5-656a4b1b52a5', 'volume_name': 'volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f659276-7994-4c12-a897-863f578eacdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f659276-7994-4c12-a897-863f578eacdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ab01d2-27a6-426c-8936-e84a63a2f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume d911c47b-fe4d-4d84-8ba5-656a4b1b52a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5', 'volume_size': 1}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1680726676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d911c47b-fe4d-4d84-8ba5-656a4b1b52a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:58Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Creating volume d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:57 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:05:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:57 devstack sudo[102375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 1073741824
Nov 05 12:05:57 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:58 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 1073741824" returned: 0 in 0.454s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:58 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5
Nov 05 12:05:58 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:58 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ab01d2-27a6-426c-8936-e84a63a2f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b074f76-eaa5-4b28-9d1d-1b64a06640b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Volume volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 (d911c47b-fe4d-4d84-8ba5-656a4b1b52a5): created successfully
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b074f76-eaa5-4b28-9d1d-1b64a06640b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (83916455-9a73-4913-a7f8-ee307f3002d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d23b0c2d-5d5b-4ce0-b126-8fd642b7c073 tempest-VolumesSnapshotTestJSON-1940732208 None] Created volume successfully.
Nov 05 12:06:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Creating offline snapshot e19e6611-2c8e-4b6e-be38-f951bf477c9c of volume d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95316f7-8fbd-42b2-a2bc-610a54ea3422]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:00 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5
Nov 05 12:06:00 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:00 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" returned: 0 in 0.439s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:00 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c 1G
Nov 05 12:06:00 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:01 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c 1G" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:01 devstack sudo[102430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c
Nov 05 12:06:01 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:01 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:01 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c is being set with open permissions: ugo+rw
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:01 devstack sudo[102435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c
Nov 05 12:06:01 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:01 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:01 devstack sudo[102438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.info
Nov 05 12:06:01 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Flow 'volume_create_manager' (6da73a9f-dd13-439e-a7da-2f3882e2d514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6555be92-63e9-489d-8abe-88f2f5eda8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6555be92-63e9-489d-8abe-88f2f5eda8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1754554261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d16ef1e-614b-4a6c-982c-97016a1603de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e62bb56d104a26a6a74412a4750013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:02Z,use_quota=True,user_id='92121cc8ccaa49799272606bee91524a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c7fa51-82c0-4000-8c02-308e9cc0f492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c7fa51-82c0-4000-8c02-308e9cc0f492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e349f4-6de3-4647-9a9a-d3f7b71d68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e349f4-6de3-4647-9a9a-d3f7b71d68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d16ef1e-614b-4a6c-982c-97016a1603de', 'volume_name': 'volume-7d16ef1e-614b-4a6c-982c-97016a1603de', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e538e9-a137-4859-9b53-f87b67556e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e538e9-a137-4859-9b53-f87b67556e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e360af21-ef0a-46b3-942f-a90c16a1d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Volume 7d16ef1e-614b-4a6c-982c-97016a1603de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d16ef1e-614b-4a6c-982c-97016a1603de', 'volume_size': 1}
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:01 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.info" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:01 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.info is being set with open permissions: ugo+rw
Nov 05 12:06:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:01 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.info
Nov 05 12:06:01 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.info" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1754554261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d16ef1e-614b-4a6c-982c-97016a1603de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e62bb56d104a26a6a74412a4750013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:02Z,use_quota=True,user_id='92121cc8ccaa49799272606bee91524a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Creating volume 7d16ef1e-614b-4a6c-982c-97016a1603de {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:02 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:02 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de 1073741824
Nov 05 12:06:02 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-174a33ca-9a23-43fd-a590-956ff963b9fb tempest-VolumesSnapshotTestJSON-1940732208 None] Create snapshot completed successfully
Nov 05 12:06:02 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de 1073741824" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:02 devstack sudo[102450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de
Nov 05 12:06:02 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e360af21-ef0a-46b3-942f-a90c16a1d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d16ef1e-614b-4a6c-982c-97016a1603de', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c622154b-4519-4c77-bc5e-8bdce29e9fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Volume volume-7d16ef1e-614b-4a6c-982c-97016a1603de (7d16ef1e-614b-4a6c-982c-97016a1603de): created successfully
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c622154b-4519-4c77-bc5e-8bdce29e9fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Flow 'volume_create_manager' (6da73a9f-dd13-439e-a7da-2f3882e2d514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ba51a1a2-fb92-48ca-baae-190ded5577a5 tempest-AbsoluteLimitsTests-888345624 None] Created volume successfully.
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (2ad7ad2e-f08a-489c-9b78-8c1213ae30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c7a491-5e48-46dd-826a-981642f9dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c7a491-5e48-46dd-826a-981642f9dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-892357467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0585410e-2c21-418a-99bc-ee06be62d696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9501f3e2d67a41c2af83c684a2eb9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e19e6611-2c8e-4b6e-be38-f951bf477c9c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:04Z,use_quota=True,user_id='741c9619ed6b4c84b75e0af1779e323b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535cc61b-313c-4cd6-809e-c8b6bd7a5575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535cc61b-313c-4cd6-809e-c8b6bd7a5575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295e9140-e3d9-4f98-b78a-dbbe3e401ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295e9140-e3d9-4f98-b78a-dbbe3e401ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0585410e-2c21-418a-99bc-ee06be62d696', 'volume_name': 'volume-0585410e-2c21-418a-99bc-ee06be62d696', 'volume_size': 1, 'snapshot_id': 'e19e6611-2c8e-4b6e-be38-f951bf477c9c'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8dc4ed-c597-435b-ac30-a66ccd4ded7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8dc4ed-c597-435b-ac30-a66ccd4ded7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cacda4-33bc-406c-b207-3c380b3af1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Volume 0585410e-2c21-418a-99bc-ee06be62d696: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0585410e-2c21-418a-99bc-ee06be62d696', 'volume_size': 1, 'snapshot_id': 'e19e6611-2c8e-4b6e-be38-f951bf477c9c'}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-e19e6611-2c8e-4b6e-be38-f951bf477c9c-0585410e-2c21-418a-99bc-ee06be62d696" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-e19e6611-2c8e-4b6e-be38-f951bf477c9c-0585410e-2c21-418a-99bc-ee06be62d696" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Creating volume 0585410e-2c21-418a-99bc-ee06be62d696 from snapshot e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-0585410e-2c21-418a-99bc-ee06be62d696" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-0585410e-2c21-418a-99bc-ee06be62d696" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] snapshot: e19e6611-2c8e-4b6e-be38-f951bf477c9c, volume: 0585410e-2c21-418a-99bc-ee06be62d696,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e891a12-514d-4cb3-a254-8d32b60567c4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Acquiring lock "cinder-7d16ef1e-614b-4a6c-982c-97016a1603de-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Lock "cinder-7d16ef1e-614b-4a6c-982c-97016a1603de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Acquiring lock "cinder-quobyte-7d16ef1e-614b-4a6c-982c-97016a1603de" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:04 devstack sudo[102454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c
Nov 05 12:06:04 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Lock "cinder-quobyte-7d16ef1e-614b-4a6c-982c-97016a1603de" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[762cd723-8428-4002-a90d-24b339d9c25f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de
Nov 05 12:06:04 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:04 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b325854c-7f37-400f-ba65-3bf4bacfd886]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack sudo[102461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5
Nov 05 12:06:04 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:04 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack sudo[102466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de
Nov 05 12:06:04 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:04 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7d16ef1e-614b-4a6c-982c-97016a1603de" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:04 devstack sudo[102472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Lock "cinder-quobyte-7d16ef1e-614b-4a6c-982c-97016a1603de" released by "delete_volume" :: held 0.695s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:04 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Created reservations ['faa7474b-e4cf-4930-8dbd-e1882aee5b3d', '1a1c3a21-0f9a-4cdf-8bff-54bdf6eda1c3', '0176b794-ca65-49bc-981c-8eaddbcf7ec3', '05c5c241-9b68-447a-97df-e1b572b100d4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:04 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:05 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Deleted volume successfully.
Nov 05 12:06:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c47c878-cc05-416d-90fe-64eb61b6a495 tempest-AbsoluteLimitsTests-888345624 None] Lock "cinder-7d16ef1e-614b-4a6c-982c-97016a1603de-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:11 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696" returned: 0 in 6.779s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:06:11 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Converted 1024.00 MB image at 151.03 MB/s
Nov 05 12:06:11 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696 is being set with open permissions: ugo+rw
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:11 devstack sudo[102489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696
Nov 05 12:06:11 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:11 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-0585410e-2c21-418a-99bc-ee06be62d696" released by "_copy_volume_from_snapshot" :: held 7.925s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=135,cinder:UPDATE=152,cinder:DELETE=13,cinder:INSERT=37 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=122,cinder:UPDATE=164,cinder:INSERT=40,cinder:DELETE=14 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-e19e6611-2c8e-4b6e-be38-f951bf477c9c-0585410e-2c21-418a-99bc-ee06be62d696" released by "_create_volume_from_snapshot" :: held 8.006s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.032s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cacda4-33bc-406c-b207-3c380b3af1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0585410e-2c21-418a-99bc-ee06be62d696', 'volume_size': 1, 'snapshot_id': 'e19e6611-2c8e-4b6e-be38-f951bf477c9c'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d41466-648f-4e2a-b21c-75c0c98b68ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Volume volume-0585410e-2c21-418a-99bc-ee06be62d696 (0585410e-2c21-418a-99bc-ee06be62d696): created successfully
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d41466-648f-4e2a-b21c-75c0c98b68ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Flow 'volume_create_manager' (2ad7ad2e-f08a-489c-9b78-8c1213ae30c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8ff308d9-ad74-48cf-b2c0-93950c38b2fc tempest-VolumesSnapshotTestJSON-1940732208 None] Created volume successfully.
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-0585410e-2c21-418a-99bc-ee06be62d696-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-0585410e-2c21-418a-99bc-ee06be62d696-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Flow 'volume_create_manager' (43675a92-d232-466a-8b44-f150416f8276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb80d1e8-9b56-4eb3-a7cf-a13432339a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-0585410e-2c21-418a-99bc-ee06be62d696" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb80d1e8-9b56-4eb3-a7cf-a13432339a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-89848993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f424bc-0fc6-41e2-9ef1-902169b12f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec3c02d147964bd0a40559cd2448c49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='0c2a30a62452406b92a761c13d17c3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7834db24-1cb3-45d3-8911-738a7e4a97cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7834db24-1cb3-45d3-8911-738a7e4a97cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b61173-172d-4c7a-8418-0c86ccba8ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b61173-172d-4c7a-8418-0c86ccba8ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f424bc-0fc6-41e2-9ef1-902169b12f9a', 'volume_name': 'volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9761ae46-92d5-43d6-bc71-f37c0cc5565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9761ae46-92d5-43d6-bc71-f37c0cc5565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6785fc-9365-4e22-8bc7-769fdadf8634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Volume 15f424bc-0fc6-41e2-9ef1-902169b12f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a', 'volume_size': 1}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-89848993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f424bc-0fc6-41e2-9ef1-902169b12f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec3c02d147964bd0a40559cd2448c49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='0c2a30a62452406b92a761c13d17c3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Creating volume 15f424bc-0fc6-41e2-9ef1-902169b12f9a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:12 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-0585410e-2c21-418a-99bc-ee06be62d696" acquired by "delete_volume" :: waited 0.080s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:12 devstack sudo[102492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a 1073741824
Nov 05 12:06:12 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[304cc2b4-b3a9-4e72-b5d9-5283ab8f4aa2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:12 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696
Nov 05 12:06:12 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a 1073741824" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:13 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:13 devstack sudo[102502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696
Nov 05 12:06:13 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:13 devstack sudo[102504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a
Nov 05 12:06:13 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0585410e-2c21-418a-99bc-ee06be62d696" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-0585410e-2c21-418a-99bc-ee06be62d696" released by "delete_volume" :: held 0.681s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:13 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6785fc-9365-4e22-8bc7-769fdadf8634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f23b534-eda3-4b51-bff1-25f6069455a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Volume volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a (15f424bc-0fc6-41e2-9ef1-902169b12f9a): created successfully
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f23b534-eda3-4b51-bff1-25f6069455a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Flow 'volume_create_manager' (43675a92-d232-466a-8b44-f150416f8276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6cfcc062-3f77-4f2b-bdb0-47bbf4b95ad0 tempest-VolumesMetadataTest-1484903792 None] Created volume successfully.
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['7290c712-541d-4cb5-b707-2d9dd8b0c83e', '908c50a1-5e38-4fee-9235-372a98529b45', 'c5035e49-d1f3-43a1-bacd-c4b9d8f21fc4', 'bca20bbf-aeb1-46b0-94ed-ee8c4da0241f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:13 devstack sudo[102509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:13 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-e19e6611-2c8e-4b6e-be38-f951bf477c9c-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-e19e6611-2c8e-4b6e-be38-f951bf477c9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-e19e6611-2c8e-4b6e-be38-f951bf477c9c" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-e19e6611-2c8e-4b6e-be38-f951bf477c9c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Deleting offline snapshot e19e6611-2c8e-4b6e-be38-f951bf477c9c of volume d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] snapshot_file for this snap is: volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9bff15-1066-4165-a52c-b0f41c55d02d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:14 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Deleted volume successfully.
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-073e46c3-3b74-4ad0-ab9a-502d6f1df06f tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-0585410e-2c21-418a-99bc-ee06be62d696-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:14 devstack sudo[102512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c
Nov 05 12:06:14 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:14 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c" returned: 0 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44043a8e-8bc0-4e4f-b5d2-d129e3295190]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:14 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5
Nov 05 12:06:14 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Acquiring lock "cinder-15f424bc-0fc6-41e2-9ef1-902169b12f9a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Lock "cinder-15f424bc-0fc6-41e2-9ef1-902169b12f9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Acquiring lock "cinder-quobyte-15f424bc-0fc6-41e2-9ef1-902169b12f9a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Lock "cinder-quobyte-15f424bc-0fc6-41e2-9ef1-902169b12f9a" acquired by "delete_volume" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04feb48-fc45-4969-ba5f-d2e8b8069f3a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:14 devstack sudo[102519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a
Nov 05 12:06:14 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:15 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" returned: 0 in 0.601s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:15 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c
Nov 05 12:06:15 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:15 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:15 devstack sudo[102529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a
Nov 05 12:06:15 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:15 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-15f424bc-0fc6-41e2-9ef1-902169b12f9a" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Lock "cinder-quobyte-15f424bc-0fc6-41e2-9ef1-902169b12f9a" released by "delete_volume" :: held 0.668s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:15 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c" returned: 0 in 0.356s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:15 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c
Nov 05 12:06:15 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Created reservations ['710126b4-4b57-4b14-b352-a9c9d37aea3f', '49cc8e8b-2e15-4d40-ada4-a93364046baa', '5e107176-9e17-47b2-9a42-b5a4b278da44', '774eced1-18c5-485a-938a-7ffba5a309b8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:15 devstack sudo[102538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:15 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:15 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5.e19e6611-2c8e-4b6e-be38-f951bf477c9c" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-e19e6611-2c8e-4b6e-be38-f951bf477c9c" released by "_delete_snapshot" :: held 1.787s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" released by "delete_snapshot" :: held 1.820s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['2687dbd6-2608-440a-a3b7-e1b351144b9f', 'c72dbc21-76e0-445d-a063-acf744380f50', '0624270b-6723-4404-b9f4-1a128663036a', '2c511fd0-5b3c-4449-a2cc-a53a12e56d5f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:15 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Deleted volume successfully.
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e8b2f07-b490-4a0c-815b-f2ac0f9c5fc5 tempest-VolumesMetadataTest-1484903792 None] Lock "cinder-15f424bc-0fc6-41e2-9ef1-902169b12f9a-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Delete snapshot completed successfully.
Nov 05 12:06:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-728e9c42-d739-443f-a6cd-b7fbf3e75d7b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-e19e6611-2c8e-4b6e-be38-f951bf477c9c-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c61f5-2f19-4f98-a60c-29228544c222]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack sudo[102542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5
Nov 05 12:06:16 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:16 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack sudo[102547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5
Nov 05 12:06:16 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:16 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5" released by "delete_volume" :: held 0.705s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['15d6279b-a328-489d-b79e-bb38b22536d5', 'c28304a1-36ce-4b21-975b-45fd0db34015', '1e590824-5777-498e-98db-1086fc561e0f', 'a40633b8-933c-4949-8d8a-26f171012d2b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:17 devstack sudo[102550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:17 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:17 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Deleted volume successfully.
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ff517a14-2074-45b8-9d3b-8419f680a40b tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-d911c47b-fe4d-4d84-8ba5-656a4b1b52a5-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-f3e504e8-0109-4741-a77b-a6b8400ada87-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-f3e504e8-0109-4741-a77b-a6b8400ada87-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "cinder-quobyte-f3e504e8-0109-4741-a77b-a6b8400ada87" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-f3e504e8-0109-4741-a77b-a6b8400ada87" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7451db-e4e2-48b3-bb25-1c74cb00152d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:17 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87
Nov 05 12:06:17 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:18 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87" returned: 0 in 0.463s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:18 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87
Nov 05 12:06:18 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:18 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3e504e8-0109-4741-a77b-a6b8400ada87" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-quobyte-f3e504e8-0109-4741-a77b-a6b8400ada87" released by "delete_volume" :: held 0.828s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Created reservations ['25997df5-0140-4a8e-b101-0b372eeb2413', '856ff27a-f754-4e13-838c-77d95e30fcab', 'a443219f-0d30-4cc4-8176-b16c244d43c5', '8061eb17-baf5-41ef-a2a7-1a2bd577639b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:18 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:18 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:18 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Deleted volume successfully.
Nov 05 12:06:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-014bd00e-7c7f-4d01-a09d-68a50686d53a tempest-VolumesSnapshotTestJSON-1940732208 None] Lock "cinder-f3e504e8-0109-4741-a77b-a6b8400ada87-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (246269b4-9b1f-4b3d-ba82-8e82a26b430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f88267-6176-4236-88fe-1d2c6c6505c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f88267-6176-4236-88fe-1d2c6c6505c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-151939509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:20Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c9fe63-fc33-487e-a529-b736a71bc219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c9fe63-fc33-487e-a529-b736a71bc219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd3390a-2f45-415b-867c-3feede26651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd3390a-2f45-415b-867c-3feede26651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84', 'volume_name': 'volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720a1597-2591-4217-a2be-cc821e1e6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720a1597-2591-4217-a2be-cc821e1e6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eee3cc7-3aa0-4f91-a4e4-2990c9a1575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Volume 6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84', 'volume_size': 1}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-151939509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:20Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Creating volume 6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:19 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:19 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 1073741824
Nov 05 12:06:19 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:20 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 1073741824" returned: 0 in 0.470s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:20 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84
Nov 05 12:06:20 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:20 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eee3cc7-3aa0-4f91-a4e4-2990c9a1575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe92ec7-c7f1-44a4-9fe1-ecbeb3c275ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Volume volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 (6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84): created successfully
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe92ec7-c7f1-44a4-9fe1-ecbeb3c275ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (246269b4-9b1f-4b3d-ba82-8e82a26b430b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d0e0f829-bd21-4739-847f-6d178da2fb51 tempest-VolumesGetTest-394583996 None] Created volume successfully.
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (c93ce5fc-16d1-4ce7-8d1c-3380ec7c9953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216923b7-a7f1-48e7-a6d7-54ba219eba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216923b7-a7f1-48e7-a6d7-54ba219eba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-778708062',display_name='tempest-VolumesGetTest-Volume-302964366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308a23ac-b746-4ade-9a12-49035cc272fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:23Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a077beb5-6cf8-46a1-9f9c-46b7ab998009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a077beb5-6cf8-46a1-9f9c-46b7ab998009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea964d8-1cc3-4f1c-896e-d405d91d21db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea964d8-1cc3-4f1c-896e-d405d91d21db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308a23ac-b746-4ade-9a12-49035cc272fb', 'volume_name': 'volume-308a23ac-b746-4ade-9a12-49035cc272fb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6375863-0e15-47c0-8123-bd6b6ce41480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6375863-0e15-47c0-8123-bd6b6ce41480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f14360d-56d0-4dc8-97d4-a5bce5489d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Volume 308a23ac-b746-4ade-9a12-49035cc272fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308a23ac-b746-4ade-9a12-49035cc272fb', 'volume_size': 1}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-778708062',display_name='tempest-VolumesGetTest-Volume-302964366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308a23ac-b746-4ade-9a12-49035cc272fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:23Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Creating volume 308a23ac-b746-4ade-9a12-49035cc272fb {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:22 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:22 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb 1073741824
Nov 05 12:06:22 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:23 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb 1073741824" returned: 0 in 0.574s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:23 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb
Nov 05 12:06:23 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:23 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f14360d-56d0-4dc8-97d4-a5bce5489d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308a23ac-b746-4ade-9a12-49035cc272fb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a7b3f8-2ad4-4706-acdf-2a6fb22f9c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Volume volume-308a23ac-b746-4ade-9a12-49035cc272fb (308a23ac-b746-4ade-9a12-49035cc272fb): created successfully
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a7b3f8-2ad4-4706-acdf-2a6fb22f9c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (c93ce5fc-16d1-4ce7-8d1c-3380ec7c9953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-40c0df4a-e4b5-430b-8964-f6b25b8051e6 tempest-VolumesGetTest-394583996 None] Created volume successfully.
Nov 05 12:06:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-308a23ac-b746-4ade-9a12-49035cc272fb-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Lock "cinder-308a23ac-b746-4ade-9a12-49035cc272fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-308a23ac-b746-4ade-9a12-49035cc272fb" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-308a23ac-b746-4ade-9a12-49035cc272fb" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b6e2e-a475-4f48-b61e-90a686838311]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:25 devstack sudo[102586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb
Nov 05 12:06:25 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:25 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:25 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb
Nov 05 12:06:25 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:25 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-308a23ac-b746-4ade-9a12-49035cc272fb" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-308a23ac-b746-4ade-9a12-49035cc272fb" released by "delete_volume" :: held 0.696s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Created reservations ['8e5a1475-3399-4150-bac7-90251bca394b', '6f90c12b-c2f1-4043-94b8-89858ddb8b35', '9eac9a7e-cb78-4b29-879c-09840a4d5dce', '98bb4aa0-964e-4653-b0c1-c4bbddaa5bb1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:25 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:25 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:26 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Deleted volume successfully.
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ef7cbbc-1c15-4597-a26c-eef269ccfcf5 tempest-VolumesGetTest-394583996 None] Lock "cinder-308a23ac-b746-4ade-9a12-49035cc272fb-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Lock "cinder-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c12b9c-4715-4d8f-8881-3be49125b2dc]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:26 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84
Nov 05 12:06:26 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:26 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:26 devstack sudo[102603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84
Nov 05 12:06:26 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:26 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84" released by "delete_volume" :: held 0.712s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Created reservations ['4998a578-82f4-40ae-90dd-72b89dd35c50', 'da23f666-b336-4242-9cdf-224f78f59476', '2249470d-554b-4934-b713-f9cb108f4ea1', '601e4553-7654-4ba6-b290-7dee217b102c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:27 devstack sudo[102606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:27 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:27 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Deleted volume successfully.
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87fc32b6-5d1d-460a-881d-56f24baf989e tempest-VolumesGetTest-394583996 None] Lock "cinder-6bd99d32-fb6c-4eb0-8713-fa73ec0cbd84-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Flow 'volume_create_manager' (b438493f-6ea2-406f-90a6-ec6ebfbe1bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39593b56-18a6-4780-bf41-762ddfa94249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39593b56-18a6-4780-bf41-762ddfa94249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-610527577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739c8b4a-a65b-4e54-b854-fb705ffd5e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366be7de9f534cf8b7d607db2392685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:27Z,use_quota=True,user_id='cc2f252203bd4f088b5e62230706ffb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846bf5ed-d149-4aa6-adc2-49f95516f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846bf5ed-d149-4aa6-adc2-49f95516f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c173aa3-141e-4408-b3fe-81e8fc4ce97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c173aa3-141e-4408-b3fe-81e8fc4ce97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739c8b4a-a65b-4e54-b854-fb705ffd5e8f', 'volume_name': 'volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aab20c-2b12-498b-b6fa-d639b470f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aab20c-2b12-498b-b6fa-d639b470f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b235adc5-3c60-49b2-ba16-d27c5665978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f', 'volume_size': 1}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-610527577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739c8b4a-a65b-4e54-b854-fb705ffd5e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366be7de9f534cf8b7d607db2392685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:27Z,use_quota=True,user_id='cc2f252203bd4f088b5e62230706ffb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Creating volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:27 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:27 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f 1073741824
Nov 05 12:06:27 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (f63f0b5d-ed88-45cd-85e9-49063f86a1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40066743-9d71-42e7-9c38-3345751febeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40066743-9d71-42e7-9c38-3345751febeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1142730900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e329f895-3567-483b-a72c-4d96009685fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:28Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453fe0b3-e8d3-46ef-ad54-372aff4b57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453fe0b3-e8d3-46ef-ad54-372aff4b57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edab4c0a-2c47-4979-bc82-86574b7335d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edab4c0a-2c47-4979-bc82-86574b7335d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e329f895-3567-483b-a72c-4d96009685fe', 'volume_name': 'volume-e329f895-3567-483b-a72c-4d96009685fe', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8902ceba-0bed-4eca-9171-b76ca923652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8902ceba-0bed-4eca-9171-b76ca923652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344ee05b-3fcd-4bb5-b106-464d8254f086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Volume e329f895-3567-483b-a72c-4d96009685fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e329f895-3567-483b-a72c-4d96009685fe', 'volume_size': 1}
Nov 05 12:06:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:28 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f 1073741824" returned: 0 in 0.446s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:28 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f
Nov 05 12:06:28 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:28 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1142730900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e329f895-3567-483b-a72c-4d96009685fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:28Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Creating volume e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:28 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b235adc5-3c60-49b2-ba16-d27c5665978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4b4aa0-563d-46f7-af28-fd964c2642f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:28 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe 1073741824
Nov 05 12:06:28 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Volume volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f (739c8b4a-a65b-4e54-b854-fb705ffd5e8f): created successfully
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4b4aa0-563d-46f7-af28-fd964c2642f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Flow 'volume_create_manager' (b438493f-6ea2-406f-90a6-ec6ebfbe1bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-44b13ce5-5a0a-4726-a035-e44a08d26364 tempest-VolumesSnapshotListTestJSON-1134184188 None] Created volume successfully.
Nov 05 12:06:28 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe 1073741824" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:28 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe
Nov 05 12:06:28 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:29 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344ee05b-3fcd-4bb5-b106-464d8254f086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e329f895-3567-483b-a72c-4d96009685fe', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71167a40-aaf0-4d0b-ae7d-610c8d41a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Volume volume-e329f895-3567-483b-a72c-4d96009685fe (e329f895-3567-483b-a72c-4d96009685fe): created successfully
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71167a40-aaf0-4d0b-ae7d-610c8d41a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (f63f0b5d-ed88-45cd-85e9-49063f86a1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9895b684-48a8-49c3-bf57-0bfe582adb1b tempest-VolumesGetTest-394583996 None] Created volume successfully.
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Creating offline snapshot ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc of volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d394498-da8d-4861-a6c4-f09fdd973c4a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:29 devstack sudo[102628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f
Nov 05 12:06:29 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:30 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:30 devstack sudo[102633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc 1G
Nov 05 12:06:30 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (29fdadea-28f7-4137-8fdf-3d1d3ec4bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadd1b7e-3896-4462-b5b1-410ae7fec376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadd1b7e-3896-4462-b5b1-410ae7fec376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-39682956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ad98de-acb7-45b7-abf9-c9b7e0684bf3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e329f895-3567-483b-a72c-4d96009685fe,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:30Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e596465c-ceac-4a92-85dc-ee6a6d1d5a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e596465c-ceac-4a92-85dc-ee6a6d1d5a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fe95bc-b69a-4e30-a879-ee1e38468d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:30 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc 1G" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fe95bc-b69a-4e30-a879-ee1e38468d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '54ad98de-acb7-45b7-abf9-c9b7e0684bf3', 'volume_name': 'volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3', 'volume_size': 1, 'source_volid': 'e329f895-3567-483b-a72c-4d96009685fe', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43ff3b-875a-4fff-a25c-0c2420e80293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:30 devstack sudo[102639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc
Nov 05 12:06:30 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43ff3b-875a-4fff-a25c-0c2420e80293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c14f5b1-901a-4537-be6a-27ac5f519633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Volume 54ad98de-acb7-45b7-abf9-c9b7e0684bf3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3', 'volume_size': 1, 'source_volid': 'e329f895-3567-483b-a72c-4d96009685fe', 'source_volstatus': 'available'}
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:30 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:30 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc is being set with open permissions: ugo+rw
Nov 05 12:06:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:30 devstack sudo[102644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc
Nov 05 12:06:30 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:31 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" returned: 0 in 0.227s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:31 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.info
Nov 05 12:06:31 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:31 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.info" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:31 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.info is being set with open permissions: ugo+rw
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:31 devstack sudo[102650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.info
Nov 05 12:06:31 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:31 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.info" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:31 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Cloning volume e329f895-3567-483b-a72c-4d96009685fe to volume 54ad98de-acb7-45b7-abf9-c9b7e0684bf3
Nov 05 12:06:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1ad5ed85-6fc7-42ae-94f5-4d990c693a30 tempest-VolumesSnapshotListTestJSON-1134184188 None] Create snapshot completed successfully
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Creating offline snapshot a70e1e1b-0f03-41d3-8b47-98f2ef777d11 of volume e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[917af545-2844-4754-8f9a-6c58b81af96f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:31 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe
Nov 05 12:06:31 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:32 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe" returned: 0 in 0.374s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:32 devstack sudo[102658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 1G
Nov 05 12:06:32 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:32 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 1G" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e329f895-3567-483b-a72c-4d96009685fe -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:32 devstack sudo[102664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e329f895-3567-483b-a72c-4d96009685fe -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11
Nov 05 12:06:32 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:32 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e329f895-3567-483b-a72c-4d96009685fe -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:32 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 is being set with open permissions: ugo+rw
Nov 05 12:06:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:32 devstack sudo[102669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11
Nov 05 12:06:32 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:33 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11" returned: 0 in 0.242s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:33 devstack sudo[102672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.info
Nov 05 12:06:33 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:33 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.info" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:33 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.info is being set with open permissions: ugo+rw
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:33 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.info
Nov 05 12:06:33 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:33 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.info" returned: 0 in 0.239s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] snapshot: a70e1e1b-0f03-41d3-8b47-98f2ef777d11, volume: 54ad98de-acb7-45b7-abf9-c9b7e0684bf3,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c271ab-937b-437c-ba69-1224fbda9361]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:33 devstack sudo[102678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11
Nov 05 12:06:33 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:33 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e329f895-3567-483b-a72c-4d96009685fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae928cd2-c296-4dab-be12-7125d75c18e0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:34 devstack sudo[102684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe
Nov 05 12:06:34 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:34 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:06:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:06:34 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:06:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:34 devstack sudo[102689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3
Nov 05 12:06:34 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:39 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" returned: 0 in 5.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:06:39 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Converted 1024.00 MB image at 189.67 MB/s
Nov 05 12:06:39 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 is being set with open permissions: ugo+rw
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:39 devstack sudo[102702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3
Nov 05 12:06:39 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:39 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" returned: 0 in 0.229s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" released by "_copy_volume_from_snapshot" :: held 6.384s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-a70e1e1b-0f03-41d3-8b47-98f2ef777d11" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-a70e1e1b-0f03-41d3-8b47-98f2ef777d11" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Deleting offline snapshot a70e1e1b-0f03-41d3-8b47-98f2ef777d11 of volume e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] snapshot_file for this snap is: volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9240f39-96f4-4d63-9886-8c7692ca272e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:40 devstack sudo[102705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11
Nov 05 12:06:40 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:40 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e329f895-3567-483b-a72c-4d96009685fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f19e2a6-7e37-4f9f-9436-9ff477200727]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:40 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe
Nov 05 12:06:40 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:40 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe" returned: 0 in 0.526s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:40 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11
Nov 05 12:06:40 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:41 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11" returned: 0 in 0.351s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:41 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11
Nov 05 12:06:41 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:41 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe.a70e1e1b-0f03-41d3-8b47-98f2ef777d11" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-a70e1e1b-0f03-41d3-8b47-98f2ef777d11" released by "_delete_snapshot" :: held 1.572s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.933s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.562s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c14f5b1-901a-4537-be6a-27ac5f519633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3', 'volume_size': 1, 'source_volid': 'e329f895-3567-483b-a72c-4d96009685fe', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc05bff-3372-4f2e-a3ea-09ed4301a1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Creating offline snapshot 466cf896-9f96-4941-8a7c-bcd6676f185d of volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Volume volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 (54ad98de-acb7-45b7-abf9-c9b7e0684bf3): created successfully
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc05bff-3372-4f2e-a3ea-09ed4301a1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (29fdadea-28f7-4137-8fdf-3d1d3ec4bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97261af9-7585-43aa-a851-2e246795010c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-379dd0f6-7f1d-483b-87c5-854105c755f6 tempest-VolumesGetTest-394583996 None] Created volume successfully.
Nov 05 12:06:41 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc
Nov 05 12:06:41 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:42 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" returned: 0 in 0.359s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:42 devstack sudo[102735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d 1G
Nov 05 12:06:42 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:42 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d 1G" returned: 0 in 0.494s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:42 devstack sudo[102741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d
Nov 05 12:06:42 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:42 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:42 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d is being set with open permissions: ugo+rw
Nov 05 12:06:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:42 devstack sudo[102747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d
Nov 05 12:06:42 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (1ce29725-4097-4a7e-bce6-7cc09b0b6b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d160f9-7702-4553-a667-6beea184b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d160f9-7702-4553-a667-6beea184b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-35464514',display_name='tempest-VolumesGetTest-Volume-979981187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0248c8-c459-4fdd-80f1-a7d8faa1762f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:43Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50187817-384b-4daa-b315-e0df5a64fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50187817-384b-4daa-b315-e0df5a64fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b3a615-6644-4256-a1e0-5364a11d4943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b3a615-6644-4256-a1e0-5364a11d4943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0248c8-c459-4fdd-80f1-a7d8faa1762f', 'volume_name': 'volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602bc361-19b2-4447-a8d5-25f819dd2f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602bc361-19b2-4447-a8d5-25f819dd2f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee683c1-6290-4a0d-8b94-0ea47932633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Volume 3d0248c8-c459-4fdd-80f1-a7d8faa1762f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f', 'volume_size': 1}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:43 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.590s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-35464514',display_name='tempest-VolumesGetTest-Volume-979981187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0248c8-c459-4fdd-80f1-a7d8faa1762f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:43Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Creating volume 3d0248c8-c459-4fdd-80f1-a7d8faa1762f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:43 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:43 devstack sudo[102750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f 1073741824
Nov 05 12:06:43 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a7f99309-ca41-46fc-8ffc-191b9825aed7 tempest-VolumesSnapshotListTestJSON-1134184188 None] Create snapshot completed successfully
Nov 05 12:06:43 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f 1073741824" returned: 0 in 0.447s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:43 devstack sudo[102756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f
Nov 05 12:06:43 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:43 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee683c1-6290-4a0d-8b94-0ea47932633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c3c36f-ea46-4b49-bcb4-9a858a6d7883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Creating offline snapshot 7bfe8cd3-8de6-4bd5-a796-c849155d3982 of volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3c515-af4d-4484-b556-5fa9d39e862f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Volume volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f (3d0248c8-c459-4fdd-80f1-a7d8faa1762f): created successfully
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c3c36f-ea46-4b49-bcb4-9a858a6d7883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (1ce29725-4097-4a7e-bce6-7cc09b0b6b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fb2c7f81-a44a-469f-9755-f9e6cf5ada43 tempest-VolumesGetTest-394583996 None] Created volume successfully.
Nov 05 12:06:44 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d
Nov 05 12:06:44 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:44 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:44 devstack sudo[102765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 1G
Nov 05 12:06:44 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:44 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 1G" returned: 0 in 0.461s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:44 devstack sudo[102771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982
Nov 05 12:06:44 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:45 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:45 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 is being set with open permissions: ugo+rw
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:45 devstack sudo[102776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:45 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:45 devstack sudo[102778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:45 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-3d0248c8-c459-4fdd-80f1-a7d8faa1762f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Lock "cinder-3d0248c8-c459-4fdd-80f1-a7d8faa1762f-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-3d0248c8-c459-4fdd-80f1-a7d8faa1762f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-3d0248c8-c459-4fdd-80f1-a7d8faa1762f" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d3d78-1639-44a3-8c24-b94d9c7128f0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:45 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.564s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:45 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:06:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-10fd46d1-e388-4b07-9fd4-b81734fe520c tempest-VolumesSnapshotListTestJSON-1134184188 None] Create snapshot completed successfully
Nov 05 12:06:45 devstack sudo[102781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f
Nov 05 12:06:45 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:45 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:45 devstack sudo[102787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f
Nov 05 12:06:45 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:46 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3d0248c8-c459-4fdd-80f1-a7d8faa1762f" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-3d0248c8-c459-4fdd-80f1-a7d8faa1762f" released by "delete_volume" :: held 0.734s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Created reservations ['3fd14d3f-fc86-41e8-9bd2-2f5baff53175', '29e21a6e-f4fb-48c6-bf4f-6103ce849c6b', 'b33b4dfd-b4fd-4dc0-b606-bbaf88d01f4e', '4278ca82-4d5b-4695-926d-9101ae35640e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:46 devstack sudo[102791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:46 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-54ad98de-acb7-45b7-abf9-c9b7e0684bf3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Lock "cinder-54ad98de-acb7-45b7-abf9-c9b7e0684bf3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:46 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Deleted volume successfully.
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bdf3af-b471-4361-a4c6-2a7fd98f3366]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eb857e92-4c6d-4ecd-989e-eef2dca81d1c tempest-VolumesGetTest-394583996 None] Lock "cinder-3d0248c8-c459-4fdd-80f1-a7d8faa1762f-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:46 devstack sudo[102794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3
Nov 05 12:06:46 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-7bfe8cd3-8de6-4bd5-a796-c849155d3982-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-7bfe8cd3-8de6-4bd5-a796-c849155d3982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-quobyte-7bfe8cd3-8de6-4bd5-a796-c849155d3982" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-7bfe8cd3-8de6-4bd5-a796-c849155d3982" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Deleting offline snapshot 7bfe8cd3-8de6-4bd5-a796-c849155d3982 of volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] snapshot_file for this snap is: volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0ec41-f4e1-46df-8ac1-7c2a899b8cb2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:47 devstack sudo[102796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982
Nov 05 12:06:47 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:47 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" returned: 0 in 0.437s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:47 devstack sudo[102801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3
Nov 05 12:06:47 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:47 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:47 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-54ad98de-acb7-45b7-abf9-c9b7e0684bf3" released by "delete_volume" :: held 0.765s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa5752b-e49f-42e9-92b9-fb2db444186e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Created reservations ['f9568282-b05e-49cd-bfbe-5aea1ef4b9f4', '82fe9ebd-0fa6-4355-aefa-bfea18017f0c', '8a1d2b02-2433-4992-b38b-15a0e967b427', '1224ed93-8fd9-4093-a9b0-71825ff2c646'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:47 devstack sudo[102807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d
Nov 05 12:06:47 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:47 devstack sudo[102809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:47 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:47 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:47 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Deleted volume successfully.
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-e329f895-3567-483b-a72c-4d96009685fe-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d" returned: 0 in 0.430s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1a97e803-849a-4c67-ba57-9596f92df8e0 tempest-VolumesGetTest-394583996 None] Lock "cinder-54ad98de-acb7-45b7-abf9-c9b7e0684bf3-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:47 devstack sudo[102815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982
Nov 05 12:06:47 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Lock "cinder-e329f895-3567-483b-a72c-4d96009685fe-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-e329f895-3567-483b-a72c-4d96009685fe" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-e329f895-3567-483b-a72c-4d96009685fe" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[616a50aa-8392-42ed-bdcc-7459a286cd74]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:48 devstack sudo[102817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe
Nov 05 12:06:48 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:48 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982" returned: 0 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:48 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982
Nov 05 12:06:48 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:48 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:48 devstack sudo[102828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe
Nov 05 12:06:48 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:48 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.7bfe8cd3-8de6-4bd5-a796-c849155d3982" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-7bfe8cd3-8de6-4bd5-a796-c849155d3982" released by "_delete_snapshot" :: held 1.662s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" released by "delete_snapshot" :: held 1.689s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:48 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Created reservations ['e5215c14-e65d-476f-9a23-42aee15e95b1', 'ffe8b56e-41ce-4b01-9d97-dc646f3ba1ca', 'a7598831-fd53-436d-9cdc-b65d14e8e7d3', '763e8bf2-329d-43dd-a402-4685d47ccbc0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e329f895-3567-483b-a72c-4d96009685fe" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-e329f895-3567-483b-a72c-4d96009685fe" released by "delete_volume" :: held 0.748s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Delete snapshot completed successfully.
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d8ddedf0-649b-460e-acbe-1da181107957 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-7bfe8cd3-8de6-4bd5-a796-c849155d3982-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Created reservations ['7ad49521-5a6e-49da-a418-10f37253f02d', 'afd3663e-f1fa-49fa-aaff-ecbb5421bd60', '57f5ba3c-67b0-463b-975c-c7eb4c1595fc', 'cfac414a-7e8e-4505-a1d6-0c9ffac2df51'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:48 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:48 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-466cf896-9f96-4941-8a7c-bcd6676f185d-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-466cf896-9f96-4941-8a7c-bcd6676f185d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-quobyte-466cf896-9f96-4941-8a7c-bcd6676f185d" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:49 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.347s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Deleted volume successfully.
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-466cf896-9f96-4941-8a7c-bcd6676f185d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Deleting offline snapshot 466cf896-9f96-4941-8a7c-bcd6676f185d of volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] snapshot_file for this snap is: volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53ebef99-981e-4d0f-93ba-a6dece45a780 tempest-VolumesGetTest-394583996 None] Lock "cinder-e329f895-3567-483b-a72c-4d96009685fe-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34fe2be-1ead-4b54-a382-527d77623f00]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:49 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d
Nov 05 12:06:49 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:49 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4097cf1-42c6-4fc9-a497-19969e5f7562]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:49 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc
Nov 05 12:06:49 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (8ba07bcd-1471-4351-99d0-18030f258239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5686754-ae00-4b5b-b893-c28949fcf230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5686754-ae00-4b5b-b893-c28949fcf230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1396999071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b84c703-72aa-4b4c-9ef9-c709183dc61c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:50Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51acd96-b5e7-4b9c-a800-9018c44c210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51acd96-b5e7-4b9c-a800-9018c44c210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c9dc3-4eb4-4233-b9f6-c29e2b174673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:06:50 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:50 devstack sudo[102846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d
Nov 05 12:06:50 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c9dc3-4eb4-4233-b9f6-c29e2b174673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b84c703-72aa-4b4c-9ef9-c709183dc61c', 'volume_name': 'volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449e87da0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce0e0d4-652c-45d6-96d5-1a5f2c8da3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce0e0d4-652c-45d6-96d5-1a5f2c8da3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac6377-2246-46c6-8ea8-5905be35f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Volume 7b84c703-72aa-4b4c-9ef9-c709183dc61c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449e87da0>}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Trying to clone 7b84c703-72aa-4b4c-9ef9-c709183dc61c from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:06:50 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:50 devstack sudo[102852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d
Nov 05 12:06:50 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:06:50 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b8683d-12d2-40d0-bab2-72e645b48591]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:50 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.466cf896-9f96-4941-8a7c-bcd6676f185d" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-466cf896-9f96-4941-8a7c-bcd6676f185d" released by "_delete_snapshot" :: held 1.686s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:51 devstack sudo[102855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" released by "delete_snapshot" :: held 1.733s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:51 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Created reservations ['04fce2e7-7dcc-446a-824c-5758f3a1a9b7', 'c31a6d30-396a-49a0-955d-8a564af320e3', '08a6eb51-6eb6-4aca-b2e5-20baadcc7c47', '7a002c0a-72bf-47ff-bb86-3980a246f324'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Delete snapshot completed successfully.
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-648ca110-20a3-4e8c-8f48-51374d0129c3 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-466cf896-9f96-4941-8a7c-bcd6676f185d-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:51 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 is fetched for user 8c53c0adf1ef47afa1b5ccaffaa7ab30. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44625212-0435-4720-b2e1-351fb0d90c2f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:51 devstack sudo[102861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD
Nov 05 12:06:51 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-quobyte-ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Deleting offline snapshot ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc of volume 739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] snapshot_file for this snap is: volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937aa4a-fe44-495a-ae3b-6c16d1ab220d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:51 devstack sudo[102863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc
Nov 05 12:06:51 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:51 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1396999071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b84c703-72aa-4b4c-9ef9-c709183dc61c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:50Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Creating volume 7b84c703-72aa-4b4c-9ef9-c709183dc61c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:51 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:51 devstack sudo[102868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c 1073741824
Nov 05 12:06:51 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:51 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be9e9c9-c73e-49f2-ba93-ecb396f20057]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:52 devstack sudo[102876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f
Nov 05 12:06:52 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:52 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c 1073741824" returned: 0 in 0.442s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:52 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c
Nov 05 12:06:52 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:52 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" returned: 0 in 0.412s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:52 devstack sudo[102884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc
Nov 05 12:06:52 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:52 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Attempting download of 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 7b84c703-72aa-4b4c-9ef9-c709183dc61c. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe5e8e2-6f13-428c-bbd7-df4080785d47]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_on4kawrm {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:52 devstack sudo[102887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_on4kawrm
Nov 05 12:06:52 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:52 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:52 devstack sudo[102892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc
Nov 05 12:06:52 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:52 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_on4kawrm" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_on4kawrm {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:53 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:53 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_on4kawrm
Nov 05 12:06:53 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f.ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc" released by "_delete_snapshot" :: held 1.648s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" released by "delete_snapshot" :: held 1.675s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Created reservations ['0ce2132a-f75e-4a73-ae92-7ff7a7b9dc4e', '88fff520-589e-4f6d-acba-1a02f836cf3b', '4fbe6a2a-995b-473c-a5c0-c3b23a6ff598', '397cab25-9cf5-4528-93fe-5e5ecddd6727'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Delete snapshot completed successfully.
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbe51a02-fad5-404f-9613-385e8ba05c6e tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-ab4f6ff7-b75e-4071-9a67-a5503d7c9cdc-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:53 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_on4kawrm" returned: 1 in 0.356s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97690ee3-6eec-4469-b729-e1fcbb2cb426_on4kawrm' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c62e07e-b17f-4356-a9f5-3ed1535abff8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:53 devstack sudo[102901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD
Nov 05 12:06:53 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-739c8b4a-a65b-4e54-b854-fb705ffd5e8f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-739c8b4a-a65b-4e54-b854-fb705ffd5e8f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:53 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] 97690ee3-6eec-4469-b729-e1fcbb2cb426 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:53 devstack sudo[102906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c
Nov 05 12:06:53 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b1b17-f5bd-49e8-9b59-90815b46b536]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:53 devstack sudo[102909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f
Nov 05 12:06:53 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:54 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" returned: 0 in 0.451s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:54 devstack sudo[102920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f
Nov 05 12:06:54 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:54 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-quobyte-739c8b4a-a65b-4e54-b854-fb705ffd5e8f" released by "delete_volume" :: held 0.802s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Created reservations ['2d37d3b5-d113-43ae-831a-95c4189e78bb', 'a8e76f36-11ed-44cf-814b-0509b9e12191', '04aea08c-f6f5-4118-beca-a1a558043f6d', '2d45efb9-5af7-4f90-945b-9d60fefb1dc8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:54 devstack sudo[102923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:06:54 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:54 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Deleted volume successfully.
Nov 05 12:06:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8dc4cba4-f464-477d-8075-76e3df68f777 tempest-VolumesSnapshotListTestJSON-1134184188 None] Lock "cinder-739c8b4a-a65b-4e54-b854-fb705ffd5e8f-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:55 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c" returned: 0 in 2.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:55 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97690ee3-6eec-4469-b729-e1fcbb2cb426_0u65r3c0devstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:06:55 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Converted 112.00 MB image at 49.97 MB/s
Nov 05 12:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:55 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c 1G
Nov 05 12:06:55 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:56 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c 1G" returned: 0 in 0.361s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Downloaded image 97690ee3-6eec-4469-b729-e1fcbb2cb426 ((None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}])) to volume 7b84c703-72aa-4b4c-9ef9-c709183dc61c successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Temporary image 97690ee3-6eec-4469-b729-e1fcbb2cb426 for user 8c53c0adf1ef47afa1b5ccaffaa7ab30 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Marking volume 7b84c703-72aa-4b4c-9ef9-c709183dc61c as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Copying metadata from image 97690ee3-6eec-4469-b729-e1fcbb2cb426 to 7b84c703-72aa-4b4c-9ef9-c709183dc61c. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Creating volume glance metadata for volume 7b84c703-72aa-4b4c-9ef9-c709183dc61c backed by image 97690ee3-6eec-4469-b729-e1fcbb2cb426 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac6377-2246-46c6-8ea8-5905be35f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c', 'volume_size': 1, 'image_id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97690ee3-6eec-4469-b729-e1fcbb2cb426', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aac67b9b301144dba9d6e098bbddb81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97690ee3-6eec-4469-b729-e1fcbb2cb426', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97690ee3-6eec-4469-b729-e1fcbb2cb426/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449e87da0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386fdf7d-8449-4c08-ac26-1a61f232dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:56 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Volume volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c (7b84c703-72aa-4b4c-9ef9-c709183dc61c): created successfully
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386fdf7d-8449-4c08-ac26-1a61f232dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (8ba07bcd-1471-4351-99d0-18030f258239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7c5660fc-9d63-4e9e-97c3-279de35ff202 tempest-VolumesGetTest-394583996 None] Created volume successfully.
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (1c9495fa-b1f7-494c-b92b-5081a792a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6b419b-3a2d-425c-b35c-4fadc490b05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6b419b-3a2d-425c-b35c-4fadc490b05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-857770118',display_name='tempest-VolumesGetTest-Volume-1937009020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226fa06e-e62c-4cf5-9df8-011728a1066a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:58Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae3c1ba-7e07-46fc-994b-911c534eab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae3c1ba-7e07-46fc-994b-911c534eab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88aa633-6f5d-4297-a6b1-cf3075778d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88aa633-6f5d-4297-a6b1-cf3075778d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226fa06e-e62c-4cf5-9df8-011728a1066a', 'volume_name': 'volume-226fa06e-e62c-4cf5-9df8-011728a1066a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0c85c6-c587-4bf2-bd7d-efc1a662ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0c85c6-c587-4bf2-bd7d-efc1a662ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abed3162-3f01-44c5-ad0b-63278e20e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Volume 226fa06e-e62c-4cf5-9df8-011728a1066a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226fa06e-e62c-4cf5-9df8-011728a1066a', 'volume_size': 1}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-857770118',display_name='tempest-VolumesGetTest-Volume-1937009020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226fa06e-e62c-4cf5-9df8-011728a1066a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304b29a6157d436d9c7ca029ad6d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:58Z,use_quota=True,user_id='8c53c0adf1ef47afa1b5ccaffaa7ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Creating volume 226fa06e-e62c-4cf5-9df8-011728a1066a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:58 devstack sudo[102932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a 1073741824
Nov 05 12:06:58 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:58 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a 1073741824" returned: 0 in 0.475s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:58 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a
Nov 05 12:06:58 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:59 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abed3162-3f01-44c5-ad0b-63278e20e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226fa06e-e62c-4cf5-9df8-011728a1066a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b9e094-85b0-44af-9099-6a1b8d50b05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Volume volume-226fa06e-e62c-4cf5-9df8-011728a1066a (226fa06e-e62c-4cf5-9df8-011728a1066a): created successfully
Nov 05 12:06:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b9e094-85b0-44af-9099-6a1b8d50b05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Flow 'volume_create_manager' (1c9495fa-b1f7-494c-b92b-5081a792a25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8795993d-4eb4-4310-b8bf-5cac339aae8b tempest-VolumesGetTest-394583996 None] Created volume successfully.
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-226fa06e-e62c-4cf5-9df8-011728a1066a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Lock "cinder-226fa06e-e62c-4cf5-9df8-011728a1066a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-226fa06e-e62c-4cf5-9df8-011728a1066a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-226fa06e-e62c-4cf5-9df8-011728a1066a" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f560ab-23dd-49d3-bd9a-598861b7ab6d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:00 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a
Nov 05 12:07:00 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:00 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:00 devstack sudo[102980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a
Nov 05 12:07:00 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:01 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-226fa06e-e62c-4cf5-9df8-011728a1066a" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-226fa06e-e62c-4cf5-9df8-011728a1066a" released by "delete_volume" :: held 0.799s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Created reservations ['4dab6133-3caf-496c-be23-d3fbbcaf5206', 'fd57e707-9076-4b51-b34e-b93521a71332', '0b95be76-46de-412c-b98b-a35564ddfa15', '1ccad145-2f6b-4891-98dd-6fa900bbb879'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:01 devstack sudo[102985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:07:01 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-7b84c703-72aa-4b4c-9ef9-c709183dc61c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Lock "cinder-7b84c703-72aa-4b4c-9ef9-c709183dc61c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Acquiring lock "cinder-quobyte-7b84c703-72aa-4b4c-9ef9-c709183dc61c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:01 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-7b84c703-72aa-4b4c-9ef9-c709183dc61c" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:07:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Deleted volume successfully.
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71c708-96ac-4b5b-a152-a17827112e69]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c63cf11a-99c7-4b2d-9f38-2ce1963a831a tempest-VolumesGetTest-394583996 None] Lock "cinder-226fa06e-e62c-4cf5-9df8-011728a1066a-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:01 devstack sudo[102988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c
Nov 05 12:07:01 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:02 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:02 devstack sudo[102993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c
Nov 05 12:07:02 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:02 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7b84c703-72aa-4b4c-9ef9-c709183dc61c" returned: 0 in 0.352s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Lock "cinder-quobyte-7b84c703-72aa-4b4c-9ef9-c709183dc61c" released by "delete_volume" :: held 0.783s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Created reservations ['f6a45e25-7ce6-4d2e-986a-34f32fc5af86', 'de0a9df1-ba25-449a-a71e-6aa0bc167161', 'ad0b2de7-1a68-4bb3-95b2-e4fd964cc547', '507f1d7c-032c-4259-8c29-301334e80a97'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:02 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:07:02 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:02 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:07:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Deleted volume successfully.
Nov 05 12:07:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-262e40df-3d29-4080-b0c3-0e781f5dfb19 tempest-VolumesGetTest-394583996 None] Lock "cinder-7b84c703-72aa-4b4c-9ef9-c709183dc61c-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:12 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=126,cinder:UPDATE=157,cinder:INSERT=46,cinder:DELETE=10 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:07:13 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=110,cinder:INSERT=44,cinder:UPDATE=150,cinder:DELETE=15 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Flow 'volume_create_manager' (b07cfab0-734c-45bd-8c4c-1e23202eb402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af6636d-7533-4706-84b4-9d744652a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af6636d-7533-4706-84b4-9d744652a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1952985042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6311162-07c1-4030-8641-bd64005425ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c872fd601f6542a794e6bec57bce783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:32Z,use_quota=True,user_id='8d6a70e64e374ef4a06ad32fb0bdf8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cb246be-66ab-4f96-aae0-f226ba097c6d),volume_type_id=6cb246be-66ab-4f96-aae0-f226ba097c6d)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c35b2f7-ad21-4863-88b7-dac654b48b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c35b2f7-ad21-4863-88b7-dac654b48b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ccfefd-2d1a-48a5-a362-7f7de2be6964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ccfefd-2d1a-48a5-a362-7f7de2be6964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6311162-07c1-4030-8641-bd64005425ee', 'volume_name': 'volume-f6311162-07c1-4030-8641-bd64005425ee', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63096dd2-7b27-4f4c-adfe-f97936bc6a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63096dd2-7b27-4f4c-adfe-f97936bc6a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5de5c18-05d1-4941-8ed6-65b372b90959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Volume f6311162-07c1-4030-8641-bd64005425ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6311162-07c1-4030-8641-bd64005425ee', 'volume_size': 1}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1952985042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6311162-07c1-4030-8641-bd64005425ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c872fd601f6542a794e6bec57bce783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:32Z,use_quota=True,user_id='8d6a70e64e374ef4a06ad32fb0bdf8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cb246be-66ab-4f96-aae0-f226ba097c6d),volume_type_id=6cb246be-66ab-4f96-aae0-f226ba097c6d)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Creating volume f6311162-07c1-4030-8641-bd64005425ee {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:32 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee 1073741824
Nov 05 12:07:32 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Flow 'volume_create_manager' (98853d98-ef9e-4611-af42-befc653605d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a8402-6948-4869-90f3-495dcb21d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a8402-6948-4869-90f3-495dcb21d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1838751379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3443227-0de9-42bd-af63-87f41571da02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c872fd601f6542a794e6bec57bce783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:33Z,use_quota=True,user_id='8d6a70e64e374ef4a06ad32fb0bdf8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e62aeef8-1b3b-4b36-954e-9616c809709b),volume_type_id=e62aeef8-1b3b-4b36-954e-9616c809709b)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6115dc4-2f8e-44ba-9227-23de1e931e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6115dc4-2f8e-44ba-9227-23de1e931e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5403cd4b-ab44-4feb-8e56-02d6202843a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5403cd4b-ab44-4feb-8e56-02d6202843a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3443227-0de9-42bd-af63-87f41571da02', 'volume_name': 'volume-f3443227-0de9-42bd-af63-87f41571da02', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1deb006b-197a-42f4-a6d9-31ed9dbda267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1deb006b-197a-42f4-a6d9-31ed9dbda267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3058b8-741f-4829-afcb-1779d9abe416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Volume f3443227-0de9-42bd-af63-87f41571da02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3443227-0de9-42bd-af63-87f41571da02', 'volume_size': 1}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:33 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee 1073741824" returned: 0 in 0.796s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:33 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee
Nov 05 12:07:33 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:33 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.411s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1838751379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3443227-0de9-42bd-af63-87f41571da02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c872fd601f6542a794e6bec57bce783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:33Z,use_quota=True,user_id='8d6a70e64e374ef4a06ad32fb0bdf8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e62aeef8-1b3b-4b36-954e-9616c809709b),volume_type_id=e62aeef8-1b3b-4b36-954e-9616c809709b)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Creating volume f3443227-0de9-42bd-af63-87f41571da02 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:33 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5de5c18-05d1-4941-8ed6-65b372b90959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6311162-07c1-4030-8641-bd64005425ee', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b71d16a-1669-4d86-9504-a543b7859400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02 1073741824
Nov 05 12:07:33 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Volume volume-f6311162-07c1-4030-8641-bd64005425ee (f6311162-07c1-4030-8641-bd64005425ee): created successfully
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b71d16a-1669-4d86-9504-a543b7859400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Flow 'volume_create_manager' (b07cfab0-734c-45bd-8c4c-1e23202eb402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-65ae0787-f7f3-4a3c-8285-57eb36e9e236 tempest-TestInstancesWithCinderVolumes-143367697 None] Created volume successfully.
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Flow 'volume_create_manager' (7bb106c0-3709-4830-83a8-39aa6c105c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5cf909-e4de-48ad-a8a4-61e724032c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5cf909-e4de-48ad-a8a4-61e724032c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-659494819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2322e5c-cfca-4083-81d1-a42c3359a8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c872fd601f6542a794e6bec57bce783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:33Z,use_quota=True,user_id='8d6a70e64e374ef4a06ad32fb0bdf8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752ff372-cfec-4695-8015-c8122933cdf7),volume_type_id=752ff372-cfec-4695-8015-c8122933cdf7)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a1db46-a506-4805-ad8c-e8267a4250a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a1db46-a506-4805-ad8c-e8267a4250a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2821282-04c5-474e-b371-0ac1016e3103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:33 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2821282-04c5-474e-b371-0ac1016e3103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2322e5c-cfca-4083-81d1-a42c3359a8dd', 'volume_name': 'volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd', 'volume_size': 1, 'image_id': '9d34d209-487b-4865-aa98-b05c3544440b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d34d209-487b-4865-aa98-b05c3544440b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--719553395', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c872fd601f6542a794e6bec57bce783f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d34d209-487b-4865-aa98-b05c3544440b', 'created_at': datetime.datetime(2026, 11, 5, 11, 7, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 7, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d34d209-487b-4865-aa98-b05c3544440b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449cdbad0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8e264-69bc-453d-a816-0064cb22cb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8e264-69bc-453d-a816-0064cb22cb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49416c3a-3fcb-4b50-9da2-105ff94226e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Volume f2322e5c-cfca-4083-81d1-a42c3359a8dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd', 'volume_size': 1, 'image_id': '9d34d209-487b-4865-aa98-b05c3544440b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d34d209-487b-4865-aa98-b05c3544440b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--719553395', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c872fd601f6542a794e6bec57bce783f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d34d209-487b-4865-aa98-b05c3544440b', 'created_at': datetime.datetime(2026, 11, 5, 11, 7, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 7, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d34d209-487b-4865-aa98-b05c3544440b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449cdbad0>}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Trying to clone f2322e5c-cfca-4083-81d1-a42c3359a8dd from image 9d34d209-487b-4865-aa98-b05c3544440b at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d34d209-487b-4865-aa98-b05c3544440b', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:07:34 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02 1073741824" returned: 0 in 0.752s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:34 devstack sudo[103108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02
Nov 05 12:07:34 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:34 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02" returned: 0 in 0.308s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3058b8-741f-4829-afcb-1779d9abe416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3443227-0de9-42bd-af63-87f41571da02', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33c19a-2fe5-4ab4-9ace-82648377da86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Volume volume-f3443227-0de9-42bd-af63-87f41571da02 (f3443227-0de9-42bd-af63-87f41571da02): created successfully
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33c19a-2fe5-4ab4-9ace-82648377da86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Flow 'volume_create_manager' (98853d98-ef9e-4611-af42-befc653605d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5664a08f-4ac6-4c33-a682-17669aba3ea7 tempest-TestInstancesWithCinderVolumes-143367697 None] Created volume successfully.
Nov 05 12:07:37 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD, size 20.69 MB, duration 3.42 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:07:37 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Image download 20.69 MB at 6.05 MB/s
Nov 05 12:07:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6e831b-c629-48f5-8088-9f2e36612771]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:37 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD
Nov 05 12:07:37 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:37 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:37 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Temporary image 9d34d209-487b-4865-aa98-b05c3544440b is fetched for user 8d6a70e64e374ef4a06ad32fb0bdf8b3. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:07:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73958ec-7488-4cae-bcf6-973210b66f1c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:38 devstack sudo[103118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD
Nov 05 12:07:38 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:38 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-659494819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2322e5c-cfca-4083-81d1-a42c3359a8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c872fd601f6542a794e6bec57bce783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:33Z,use_quota=True,user_id='8d6a70e64e374ef4a06ad32fb0bdf8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752ff372-cfec-4695-8015-c8122933cdf7),volume_type_id=752ff372-cfec-4695-8015-c8122933cdf7)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Creating volume f2322e5c-cfca-4083-81d1-a42c3359a8dd {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:38 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:38 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd 1073741824
Nov 05 12:07:38 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:38 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd 1073741824" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:38 devstack sudo[103128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd
Nov 05 12:07:38 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:39 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Attempting download of 9d34d209-487b-4865-aa98-b05c3544440b ((None, [{'url': 'file:///opt/stack/data/glance/images/9d34d209-487b-4865-aa98-b05c3544440b', 'metadata': {}}])) to volume f2322e5c-cfca-4083-81d1-a42c3359a8dd. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20f76d-4d4f-444c-aa14-928742b6866b]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d34d209-487b-4865-aa98-b05c3544440b_vjer5_pq {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:39 devstack sudo[103131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d34d209-487b-4865-aa98-b05c3544440b_vjer5_pq
Nov 05 12:07:39 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:39 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d34d209-487b-4865-aa98-b05c3544440b_vjer5_pq" returned: 0 in 0.352s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d34d209-487b-4865-aa98-b05c3544440b_vjer5_pq {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:39 devstack sudo[103135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d34d209-487b-4865-aa98-b05c3544440b_vjer5_pq
Nov 05 12:07:39 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:39 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d34d209-487b-4865-aa98-b05c3544440b_vjer5_pq" returned: 1 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d34d209-487b-4865-aa98-b05c3544440b_vjer5_pq' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29e712c-2ad6-4a22-9535-1c81e112eade]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:39 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD
Nov 05 12:07:39 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:40 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:40 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] 9d34d209-487b-4865-aa98-b05c3544440b was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:07:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:40 devstack sudo[103144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd
Nov 05 12:07:40 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:41 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd" returned: 0 in 1.763s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:41 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d34d209-487b-4865-aa98-b05c3544440b_i_ceqt6odevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:07:41 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Converted 112.00 MB image at 63.47 MB/s
Nov 05 12:07:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:41 devstack sudo[103162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd 1G
Nov 05 12:07:41 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:42 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd 1G" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Downloaded image 9d34d209-487b-4865-aa98-b05c3544440b ((None, [{'url': 'file:///opt/stack/data/glance/images/9d34d209-487b-4865-aa98-b05c3544440b', 'metadata': {}}])) to volume f2322e5c-cfca-4083-81d1-a42c3359a8dd successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Temporary image 9d34d209-487b-4865-aa98-b05c3544440b for user 8d6a70e64e374ef4a06ad32fb0bdf8b3 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Marking volume f2322e5c-cfca-4083-81d1-a42c3359a8dd as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Copying metadata from image 9d34d209-487b-4865-aa98-b05c3544440b to f2322e5c-cfca-4083-81d1-a42c3359a8dd. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Creating volume glance metadata for volume f2322e5c-cfca-4083-81d1-a42c3359a8dd backed by image 9d34d209-487b-4865-aa98-b05c3544440b with: {'image_id': '9d34d209-487b-4865-aa98-b05c3544440b', 'image_name': 'tempest-scenario-img--719553395', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49416c3a-3fcb-4b50-9da2-105ff94226e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd', 'volume_size': 1, 'image_id': '9d34d209-487b-4865-aa98-b05c3544440b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d34d209-487b-4865-aa98-b05c3544440b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--719553395', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c872fd601f6542a794e6bec57bce783f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d34d209-487b-4865-aa98-b05c3544440b', 'created_at': datetime.datetime(2026, 11, 5, 11, 7, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 7, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d34d209-487b-4865-aa98-b05c3544440b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449cdbad0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb13c58-a6d2-45fd-b435-d2e2bb0440e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Volume volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd (f2322e5c-cfca-4083-81d1-a42c3359a8dd): created successfully
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb13c58-a6d2-45fd-b435-d2e2bb0440e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Flow 'volume_create_manager' (7bb106c0-3709-4830-83a8-39aa6c105c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0f94dc4e-03ef-4566-a79e-46dd9bef22fb tempest-TestInstancesWithCinderVolumes-143367697 None] Created volume successfully.
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:45 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:07:45 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:45 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-55949075-d99e-4bdc-8b3e-72b116bc4189 req-6703707e-af9a-4a32-b041-374dc20c47e2 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-55949075-d99e-4bdc-8b3e-72b116bc4189 req-6703707e-af9a-4a32-b041-374dc20c47e2 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-55949075-d99e-4bdc-8b3e-72b116bc4189 req-6703707e-af9a-4a32-b041-374dc20c47e2 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-55949075-d99e-4bdc-8b3e-72b116bc4189 req-6703707e-af9a-4a32-b041-374dc20c47e2 tempest-TestInstancesWithCinderVolumes-143367697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52d117e9-aea1-4584-8d3f-ecbcde477699', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:07:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-55949075-d99e-4bdc-8b3e-72b116bc4189 req-6703707e-af9a-4a32-b041-374dc20c47e2 tempest-TestInstancesWithCinderVolumes-143367697 None] attachment_update completed successfully.
Nov 05 12:07:55 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=23,cinder:UPDATE=16,cinder:INSERT=6 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:07:55 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Flow 'volume_create_manager' (34be8667-380c-48e7-a620-7cb176c531e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eba924-3734-4889-a541-10f5cbbec5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eba924-3734-4889-a541-10f5cbbec5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1439113632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d29ee2-3ef3-4e17-9a23-889b44a7c717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991960a22c2640dc9461f00c3cee3fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:58Z,use_quota=True,user_id='0c384054b0db404986e5a9f7bb81fe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5e50bd-52df-4f6c-b691-5476848d38d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5e50bd-52df-4f6c-b691-5476848d38d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317b0960-3750-4697-b230-aa467e069358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317b0960-3750-4697-b230-aa467e069358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d29ee2-3ef3-4e17-9a23-889b44a7c717', 'volume_name': 'volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a190597e-defa-4fb9-8e4d-b48c0f2cf462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a190597e-defa-4fb9-8e4d-b48c0f2cf462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2848760e-241c-48b5-b885-25c5d8b8636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Volume 28d29ee2-3ef3-4e17-9a23-889b44a7c717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717', 'volume_size': 1}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1439113632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d29ee2-3ef3-4e17-9a23-889b44a7c717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991960a22c2640dc9461f00c3cee3fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:58Z,use_quota=True,user_id='0c384054b0db404986e5a9f7bb81fe51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Creating volume 28d29ee2-3ef3-4e17-9a23-889b44a7c717 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:07:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:58 devstack sudo[103698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717 1073741824
Nov 05 12:07:58 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:59 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717 1073741824" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:59 devstack sudo[103703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717
Nov 05 12:07:59 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:59 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2848760e-241c-48b5-b885-25c5d8b8636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a27e5d-8ab5-422e-91ef-c969a043b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Volume volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717 (28d29ee2-3ef3-4e17-9a23-889b44a7c717): created successfully
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a27e5d-8ab5-422e-91ef-c969a043b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Flow 'volume_create_manager' (34be8667-380c-48e7-a620-7cb176c531e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9f1871ce-4e4e-481d-87d1-1e1ad4261067 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Created volume successfully.
Nov 05 12:08:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f5b65c18-deda-4bcc-b73f-52e9842f5ba9 req-8ad0255d-f5eb-4e2e-abb8-1f8dbaf2ac71 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f5b65c18-deda-4bcc-b73f-52e9842f5ba9 req-8ad0255d-f5eb-4e2e-abb8-1f8dbaf2ac71 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-f5b65c18-deda-4bcc-b73f-52e9842f5ba9 req-8ad0255d-f5eb-4e2e-abb8-1f8dbaf2ac71 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-f5b65c18-deda-4bcc-b73f-52e9842f5ba9 req-8ad0255d-f5eb-4e2e-abb8-1f8dbaf2ac71 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '182a1934-b7c6-420f-a1d6-2719c2947ecc', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:08:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-f5b65c18-deda-4bcc-b73f-52e9842f5ba9 req-8ad0255d-f5eb-4e2e-abb8-1f8dbaf2ac71 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] attachment_update completed successfully.
Nov 05 12:08:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-48ceead4-efc8-4d68-a2ff-1d17b463b3fc req-b796d26b-0340-4068-8e7e-741267130577 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Terminate volume connection completed successfully.
Nov 05 12:08:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-48ceead4-efc8-4d68-a2ff-1d17b463b3fc req-b796d26b-0340-4068-8e7e-741267130577 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Deleting attachment 182a1934-b7c6-420f-a1d6-2719c2947ecc. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:08:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Acquiring lock "cinder-28d29ee2-3ef3-4e17-9a23-889b44a7c717-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "cinder-28d29ee2-3ef3-4e17-9a23-889b44a7c717-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Acquiring lock "cinder-quobyte-28d29ee2-3ef3-4e17-9a23-889b44a7c717" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "cinder-quobyte-28d29ee2-3ef3-4e17-9a23-889b44a7c717" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a3c12-86cd-4bdf-a1f0-ce77e2461556]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:03 devstack sudo[103757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717
Nov 05 12:08:03 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:04 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:04 devstack sudo[103763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717
Nov 05 12:08:04 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:04 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-28d29ee2-3ef3-4e17-9a23-889b44a7c717" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "cinder-quobyte-28d29ee2-3ef3-4e17-9a23-889b44a7c717" released by "delete_volume" :: held 0.666s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Created reservations ['72aed560-0410-4986-b757-20d6b49715d6', '31dbd5e4-d9c8-47d0-857c-e5f5ab15fd6e', 'b97857d0-6b37-4ac8-a886-96751390c978', '18817bac-71b0-48f8-bfdd-0230698c40f0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:04 devstack sudo[103766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:08:04 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:04 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Deleted volume successfully.
Nov 05 12:08:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8e2f5a87-891e-42fe-aad7-036fc05e2bd1 tempest-TestServerVolumeAttachScenarioOldVersion-1677283765 None] Lock "cinder-28d29ee2-3ef3-4e17-9a23-889b44a7c717-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:14 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=11,cinder:SELECT=17,cinder:INSERT=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:08:14 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:08:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c4f6cce6-7274-4a60-909f-48b13fad56ed req-6b63fb28-cb3e-4a82-b43f-3674e30cbf3b tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c4f6cce6-7274-4a60-909f-48b13fad56ed req-6b63fb28-cb3e-4a82-b43f-3674e30cbf3b tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c4f6cce6-7274-4a60-909f-48b13fad56ed req-6b63fb28-cb3e-4a82-b43f-3674e30cbf3b tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-c4f6cce6-7274-4a60-909f-48b13fad56ed req-6b63fb28-cb3e-4a82-b43f-3674e30cbf3b tempest-TestInstancesWithCinderVolumes-143367697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-f6311162-07c1-4030-8641-bd64005425ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c330a41-554d-4216-bbbd-fc463071ccc0', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:08:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-c4f6cce6-7274-4a60-909f-48b13fad56ed req-6b63fb28-cb3e-4a82-b43f-3674e30cbf3b tempest-TestInstancesWithCinderVolumes-143367697 None] attachment_update completed successfully.
Nov 05 12:08:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-9e233daa-0df7-4fa6-9df0-021a5bc1a8e4 req-2bec7257-8852-4540-8321-3f90fbd1fe42 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-9e233daa-0df7-4fa6-9df0-021a5bc1a8e4 req-2bec7257-8852-4540-8321-3f90fbd1fe42 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-9e233daa-0df7-4fa6-9df0-021a5bc1a8e4 req-2bec7257-8852-4540-8321-3f90fbd1fe42 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-9e233daa-0df7-4fa6-9df0-021a5bc1a8e4 req-2bec7257-8852-4540-8321-3f90fbd1fe42 tempest-TestInstancesWithCinderVolumes-143367697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-f3443227-0de9-42bd-af63-87f41571da02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d48a603-2e05-4884-8de5-08ed7cc98089', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:08:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-9e233daa-0df7-4fa6-9df0-021a5bc1a8e4 req-2bec7257-8852-4540-8321-3f90fbd1fe42 tempest-TestInstancesWithCinderVolumes-143367697 None] attachment_update completed successfully.
Nov 05 12:08:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e37e49a2-c264-4755-8568-cc3625ecc76a req-5242834d-b0e9-4145-bd13-d57104e9ae52 tempest-TestInstancesWithCinderVolumes-143367697 None] Terminate volume connection completed successfully.
Nov 05 12:08:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e37e49a2-c264-4755-8568-cc3625ecc76a req-5242834d-b0e9-4145-bd13-d57104e9ae52 tempest-TestInstancesWithCinderVolumes-143367697 None] Deleting attachment 9c330a41-554d-4216-bbbd-fc463071ccc0. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "cinder-f6311162-07c1-4030-8641-bd64005425ee-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-f6311162-07c1-4030-8641-bd64005425ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "cinder-quobyte-f6311162-07c1-4030-8641-bd64005425ee" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-quobyte-f6311162-07c1-4030-8641-bd64005425ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0edfb44-c97e-4143-8a2c-8140734e94ca]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:29 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee
Nov 05 12:08:29 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:29 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:29 devstack sudo[103928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee
Nov 05 12:08:29 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:30 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f6311162-07c1-4030-8641-bd64005425ee" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-quobyte-f6311162-07c1-4030-8641-bd64005425ee" released by "delete_volume" :: held 0.735s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:30 devstack cinder-volume[87184]: WARNING cinder.quota [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-433790349-787901788 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-433790349-787901788, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:08:30 devstack cinder-volume[87184]: WARNING cinder.quota [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-433790349-787901788 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-433790349-787901788, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Created reservations ['e0eeda53-5bdc-4e3c-8961-d108cba03690', 'b75c8e9d-bf4f-4f6e-8deb-5c987673a480', '4742f434-ddb7-4587-93aa-ff28a7143677', 'd02c3859-7d5a-43ae-bd38-6a2bc4473344'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:30 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:08:30 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:30 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Deleted volume successfully.
Nov 05 12:08:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8be603e3-42df-4440-a254-f421907e036f tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-f6311162-07c1-4030-8641-bd64005425ee-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-75f41cf8-cea8-48ee-bf27-f0345ef756db req-293fff77-8021-48fd-9c4f-f8f02a66a617 tempest-TestInstancesWithCinderVolumes-143367697 None] Terminate volume connection completed successfully.
Nov 05 12:08:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-75f41cf8-cea8-48ee-bf27-f0345ef756db req-293fff77-8021-48fd-9c4f-f8f02a66a617 tempest-TestInstancesWithCinderVolumes-143367697 None] Deleting attachment 6d48a603-2e05-4884-8de5-08ed7cc98089. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "cinder-f3443227-0de9-42bd-af63-87f41571da02-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-f3443227-0de9-42bd-af63-87f41571da02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "cinder-quobyte-f3443227-0de9-42bd-af63-87f41571da02" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-quobyte-f3443227-0de9-42bd-af63-87f41571da02" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97977cf-9954-4aba-964d-d9bfc0832d6d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:34 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02
Nov 05 12:08:34 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:34 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02" returned: 0 in 0.459s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:34 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02
Nov 05 12:08:34 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:35 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f3443227-0de9-42bd-af63-87f41571da02" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-quobyte-f3443227-0de9-42bd-af63-87f41571da02" released by "delete_volume" :: held 0.810s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:35 devstack cinder-volume[87184]: WARNING cinder.quota [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717080789-317352030 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717080789-317352030, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:08:35 devstack cinder-volume[87184]: WARNING cinder.quota [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717080789-317352030 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717080789-317352030, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Created reservations ['89519bb8-6709-4b5c-bfd5-2d192f7d80cc', 'e395fda4-67a8-42cb-a615-03ca2369a89b', '5f483988-ecb8-4301-8641-5d4b29f41bdb', '8f4a2a72-c728-4320-a9c4-7f8e7bf12037'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:35 devstack sudo[103966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:08:35 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:35 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Deleted volume successfully.
Nov 05 12:08:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-310623f7-8032-4a5b-99e2-361e69ab4a53 tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-f3443227-0de9-42bd-af63-87f41571da02-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-1940a04d-7e85-4eba-9413-be0e2999e9a7 req-db0f7578-de05-4260-8425-76fdf6cf0835 tempest-TestInstancesWithCinderVolumes-143367697 None] Terminate volume connection completed successfully.
Nov 05 12:08:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-1940a04d-7e85-4eba-9413-be0e2999e9a7 req-db0f7578-de05-4260-8425-76fdf6cf0835 tempest-TestInstancesWithCinderVolumes-143367697 None] Deleting attachment 52d117e9-aea1-4584-8d3f-ecbcde477699. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "cinder-f2322e5c-cfca-4083-81d1-a42c3359a8dd-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-f2322e5c-cfca-4083-81d1-a42c3359a8dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "cinder-quobyte-f2322e5c-cfca-4083-81d1-a42c3359a8dd" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-quobyte-f2322e5c-cfca-4083-81d1-a42c3359a8dd" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea685dc-6174-4bd4-a488-690b7111e9a1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:41 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd
Nov 05 12:08:41 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:41 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:41 devstack sudo[104007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd
Nov 05 12:08:41 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:42 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f2322e5c-cfca-4083-81d1-a42c3359a8dd" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-quobyte-f2322e5c-cfca-4083-81d1-a42c3359a8dd" released by "delete_volume" :: held 0.826s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:42 devstack cinder-volume[87184]: WARNING cinder.quota [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-293724981-191622919 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-293724981-191622919, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:08:42 devstack cinder-volume[87184]: WARNING cinder.quota [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-293724981-191622919 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-293724981-191622919, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Created reservations ['8fcb872e-6bbf-4483-becb-9c27e55e587e', '5ddd2e53-1d8f-4483-9394-4df4b8df73ac', 'f34340f7-854e-4fbd-9b3c-3d4f4c7cbcf2', '73350a28-f4f8-40ee-9c76-b644a335d634'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:42 devstack sudo[104011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:08:42 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Flow 'volume_create_manager' (cf9d1253-e45d-4a7d-9db3-228b13678bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b952d0-c50c-4af3-9f1b-d9af2f9a6263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b952d0-c50c-4af3-9f1b-d9af2f9a6263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2140848228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876d291b-aee8-4b32-b9f6-976ae9f1c096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e43494e13b34549bff931b9f5606ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:43Z,use_quota=True,user_id='9ea6ca0223d74487a7faf7dce071cf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9dcaae-7ad5-4597-a670-d934c741095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9dcaae-7ad5-4597-a670-d934c741095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:42 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51098c0-6315-495f-a92c-86e438287cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51098c0-6315-495f-a92c-86e438287cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876d291b-aee8-4b32-b9f6-976ae9f1c096', 'volume_name': 'volume-876d291b-aee8-4b32-b9f6-976ae9f1c096', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4c149f-f904-4d86-93db-d8e5432ef8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4c149f-f904-4d86-93db-d8e5432ef8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a58719e-b7bc-4245-9eaa-0e59792b6e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Volume 876d291b-aee8-4b32-b9f6-976ae9f1c096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876d291b-aee8-4b32-b9f6-976ae9f1c096', 'volume_size': 1}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2140848228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876d291b-aee8-4b32-b9f6-976ae9f1c096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e43494e13b34549bff931b9f5606ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:43Z,use_quota=True,user_id='9ea6ca0223d74487a7faf7dce071cf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Creating volume 876d291b-aee8-4b32-b9f6-976ae9f1c096 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:08:42 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.443s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Deleted volume successfully.
Nov 05 12:08:42 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 1073741824
Nov 05 12:08:42 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e5a6ff66-b028-4446-9b51-4ea9d187850e tempest-TestInstancesWithCinderVolumes-143367697 None] Lock "cinder-f2322e5c-cfca-4083-81d1-a42c3359a8dd-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:43 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 1073741824" returned: 0 in 0.547s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:43 devstack sudo[104019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096
Nov 05 12:08:43 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:43 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a58719e-b7bc-4245-9eaa-0e59792b6e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876d291b-aee8-4b32-b9f6-976ae9f1c096', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc00669b-9024-44fb-ae46-79d558644298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Volume volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 (876d291b-aee8-4b32-b9f6-976ae9f1c096): created successfully
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc00669b-9024-44fb-ae46-79d558644298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Flow 'volume_create_manager' (cf9d1253-e45d-4a7d-9db3-228b13678bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a2cfcbf6-8eba-41d1-a2f6-e4b0530d7cb8 tempest-TestImageHashVerification-1606171636 None] Created volume successfully.
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:45 devstack sudo[104024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:08:45 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1034bbea-7369-4fb7-bb8d-3467bfc2967e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:45 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:08:45 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096
Nov 05 12:08:45 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:45 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c6503-28e6-454d-bc88-0e387ab852ce]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:45 devstack sudo[104032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096
Nov 05 12:08:45 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:46 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 /opt/stack/data/cinder/conversion/876d291b-aee8-4b32-b9f6-976ae9f1c096.temp_image.c765be15-fc3b-44f8-befb-a5ceee087b884xopp33i.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:46 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 /opt/stack/data/cinder/conversion/876d291b-aee8-4b32-b9f6-976ae9f1c096.temp_image.c765be15-fc3b-44f8-befb-a5ceee087b884xopp33i.img
Nov 05 12:08:46 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:52 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 /opt/stack/data/cinder/conversion/876d291b-aee8-4b32-b9f6-976ae9f1c096.temp_image.c765be15-fc3b-44f8-befb-a5ceee087b884xopp33i.img" returned: 0 in 6.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c968d0e4-f7d8-45d5-b077-506faad4df50]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:52 devstack sudo[104054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096
Nov 05 12:08:52 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:53 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096" returned: 0 in 0.567s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:53 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/conversion/876d291b-aee8-4b32-b9f6-976ae9f1c096.temp_image.c765be15-fc3b-44f8-befb-a5ceee087b884xopp33i.img {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:08:53 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Converted 1024.00 MB image at 158.07 MB/s
Nov 05 12:08:53 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] c765be15-fc3b-44f8-befb-a5ceee087b88 was raw, no need to convert to raw {{(pid=87184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 12:09:03 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=36,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:03 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=33,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.390s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Uploaded volume to glance image-id: c765be15-fc3b-44f8-befb-a5ceee087b88. {{(pid=87184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 12:09:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-76950f6c-43e4-4fd1-8509-493570b80a14 tempest-TestImageHashVerification-1606171636 None] Copy volume to image completed successfully.
Nov 05 12:09:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Acquiring lock "cinder-876d291b-aee8-4b32-b9f6-976ae9f1c096-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Lock "cinder-876d291b-aee8-4b32-b9f6-976ae9f1c096-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Acquiring lock "cinder-quobyte-876d291b-aee8-4b32-b9f6-976ae9f1c096" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Lock "cinder-quobyte-876d291b-aee8-4b32-b9f6-976ae9f1c096" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b8362-73f0-4726-b425-83955f0f78f3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:16 devstack sudo[104101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096
Nov 05 12:09:16 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:17 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096" returned: 0 in 0.446s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:17 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096
Nov 05 12:09:17 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:17 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-876d291b-aee8-4b32-b9f6-976ae9f1c096" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Lock "cinder-quobyte-876d291b-aee8-4b32-b9f6-976ae9f1c096" released by "delete_volume" :: held 0.800s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Created reservations ['5b57d4d1-c7de-4db1-ad18-054ed147cf1b', '5f44f41f-42ce-4c20-9190-d9a8a11e7f23', '9840b54c-8dbf-4d58-9424-4a99d779b8f8', 'd76abe7c-cc64-468b-904d-18f8ca51dc08'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:17 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:09:17 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:17 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Deleted volume successfully.
Nov 05 12:09:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b6dc4d37-8043-4ca5-8ea2-0b109a3b0381 tempest-TestImageHashVerification-1606171636 None] Lock "cinder-876d291b-aee8-4b32-b9f6-976ae9f1c096-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:27 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:27 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Flow 'volume_create_manager' (e65a96e9-8add-46b6-9a90-433246caea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c768b19-2019-4224-8f00-ac5de369c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c768b19-2019-4224-8f00-ac5de369c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1383559391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a494179d-8a8a-43ea-8e73-3752c2ed9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1061087b477e441380082d0f6857e95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:31Z,use_quota=True,user_id='95ae92d81a7145e5844e6a05ea77595c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8febe65e-64d4-4ea7-943e-60613fba8f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8febe65e-64d4-4ea7-943e-60613fba8f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c57c186-a91a-48ef-9ffd-36d704e6cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c57c186-a91a-48ef-9ffd-36d704e6cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a494179d-8a8a-43ea-8e73-3752c2ed9272', 'volume_name': 'volume-a494179d-8a8a-43ea-8e73-3752c2ed9272', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bb73ed-ebb3-45cd-8ddf-1ba93eeaf3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bb73ed-ebb3-45cd-8ddf-1ba93eeaf3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc702240-5bbb-4ef2-b02b-b64472c8173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Volume a494179d-8a8a-43ea-8e73-3752c2ed9272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a494179d-8a8a-43ea-8e73-3752c2ed9272', 'volume_size': 1}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1383559391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a494179d-8a8a-43ea-8e73-3752c2ed9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1061087b477e441380082d0f6857e95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:31Z,use_quota=True,user_id='95ae92d81a7145e5844e6a05ea77595c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Creating volume a494179d-8a8a-43ea-8e73-3752c2ed9272 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:30 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:09:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:30 devstack sudo[104221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272 1073741824
Nov 05 12:09:30 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:31 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272 1073741824" returned: 0 in 0.491s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:31 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272
Nov 05 12:09:31 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:31 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc702240-5bbb-4ef2-b02b-b64472c8173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a494179d-8a8a-43ea-8e73-3752c2ed9272', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc90bbf-bfba-4ae0-be96-25f05005919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:31 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Volume volume-a494179d-8a8a-43ea-8e73-3752c2ed9272 (a494179d-8a8a-43ea-8e73-3752c2ed9272): created successfully
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc90bbf-bfba-4ae0-be96-25f05005919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Flow 'volume_create_manager' (e65a96e9-8add-46b6-9a90-433246caea9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a9b3628f-9dfd-479d-b0d0-4eebdd586571 tempest-TestMinimumBasicScenario-36556594 None] Created volume successfully.
Nov 05 12:09:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-37a89c79-380a-447f-a939-c46ddb2c62f1 req-0d7453a2-312b-40dc-ac2c-8966df2d0629 tempest-TestMinimumBasicScenario-36556594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-37a89c79-380a-447f-a939-c46ddb2c62f1 req-0d7453a2-312b-40dc-ac2c-8966df2d0629 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-37a89c79-380a-447f-a939-c46ddb2c62f1 req-0d7453a2-312b-40dc-ac2c-8966df2d0629 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-37a89c79-380a-447f-a939-c46ddb2c62f1 req-0d7453a2-312b-40dc-ac2c-8966df2d0629 tempest-TestMinimumBasicScenario-36556594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-a494179d-8a8a-43ea-8e73-3752c2ed9272', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec96ff9b-e5be-4606-bc6f-02039e04e24d', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:09:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-37a89c79-380a-447f-a939-c46ddb2c62f1 req-0d7453a2-312b-40dc-ac2c-8966df2d0629 tempest-TestMinimumBasicScenario-36556594 None] attachment_update completed successfully.
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:45 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:09:45 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:45 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:09:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:09:53 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=5,cinder:SELECT=10 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:53 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Flow 'volume_create_manager' (c70a1ee1-e958-4999-be2d-a2c74f6bc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72865300-5156-4dd9-bb4f-e78eccf94c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72865300-5156-4dd9-bb4f-e78eccf94c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1840633246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbc405e-5e9d-48a2-9cf8-fbf4588da10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7239bf0ff804ee189f27aea350d034d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:56Z,use_quota=True,user_id='1a0f566137bd423d8155ccd1af6aced5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b91819c-a40a-4b7a-87f6-a71ab05c24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b91819c-a40a-4b7a-87f6-a71ab05c24f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dd2bce-47dd-4523-aca3-9f5e8710057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dd2bce-47dd-4523-aca3-9f5e8710057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbc405e-5e9d-48a2-9cf8-fbf4588da10f', 'volume_name': 'volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1957d480-6465-4a3c-a24e-dc80d38de7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1957d480-6465-4a3c-a24e-dc80d38de7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd0d57d-066f-4364-be0f-26af487e98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:56 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Volume 2dbc405e-5e9d-48a2-9cf8-fbf4588da10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f', 'volume_size': 1}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1840633246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbc405e-5e9d-48a2-9cf8-fbf4588da10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7239bf0ff804ee189f27aea350d034d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:56Z,use_quota=True,user_id='1a0f566137bd423d8155ccd1af6aced5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Creating volume 2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:56 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:56 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f 1073741824
Nov 05 12:09:56 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:56 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f 1073741824" returned: 0 in 0.547s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:56 devstack sudo[104780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f
Nov 05 12:09:56 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:57 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" returned: 0 in 0.355s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd0d57d-066f-4364-be0f-26af487e98c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be13516-f058-469d-b413-adaeff36ea7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Volume volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f (2dbc405e-5e9d-48a2-9cf8-fbf4588da10f): created successfully
Nov 05 12:09:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be13516-f058-469d-b413-adaeff36ea7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Flow 'volume_create_manager' (c70a1ee1-e958-4999-be2d-a2c74f6bc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9e40df75-06db-4e32-9373-b076f748d7ab tempest-TestStampPattern-1779916837 None] Created volume successfully.
Nov 05 12:10:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-5a36c957-35c5-4868-835b-9b6c49d02c74 req-658efac9-da93-400c-9ba7-e7e4a193dee1 tempest-TestMinimumBasicScenario-36556594 None] Terminate volume connection completed successfully.
Nov 05 12:10:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-5a36c957-35c5-4868-835b-9b6c49d02c74 req-658efac9-da93-400c-9ba7-e7e4a193dee1 tempest-TestMinimumBasicScenario-36556594 None] Deleting attachment ec96ff9b-e5be-4606-bc6f-02039e04e24d. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Acquiring lock "cinder-a494179d-8a8a-43ea-8e73-3752c2ed9272-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Lock "cinder-a494179d-8a8a-43ea-8e73-3752c2ed9272-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Acquiring lock "cinder-quobyte-a494179d-8a8a-43ea-8e73-3752c2ed9272" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Lock "cinder-quobyte-a494179d-8a8a-43ea-8e73-3752c2ed9272" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:10:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33183d9f-c3f9-4bec-a3ca-739f752597ae]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:20 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272
Nov 05 12:10:20 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:21 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:21 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272
Nov 05 12:10:21 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:21 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a494179d-8a8a-43ea-8e73-3752c2ed9272" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Lock "cinder-quobyte-a494179d-8a8a-43ea-8e73-3752c2ed9272" released by "delete_volume" :: held 0.663s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Created reservations ['0f882cc3-9d38-4261-a9c9-b79ff66e35ec', '35173492-cdd8-402c-a280-d00a3d4d2cbd', 'ef4a5b6d-459f-4f84-b972-49d73dd51d54', '75932419-4df5-48e7-93d4-dfa754d63bc2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:21 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:10:21 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:21 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:10:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Deleted volume successfully.
Nov 05 12:10:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d174fc70-4db6-47c5-be79-23d399faaad3 tempest-TestMinimumBasicScenario-36556594 None] Lock "cinder-a494179d-8a8a-43ea-8e73-3752c2ed9272-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7ae197ff-afd4-470e-bc30-0cf5f0561cc9 req-00067e87-4e1d-46ce-a9a9-388278f6f29a tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7ae197ff-afd4-470e-bc30-0cf5f0561cc9 req-00067e87-4e1d-46ce-a9a9-388278f6f29a tempest-TestStampPattern-1779916837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7ae197ff-afd4-470e-bc30-0cf5f0561cc9 req-00067e87-4e1d-46ce-a9a9-388278f6f29a tempest-TestStampPattern-1779916837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-7ae197ff-afd4-470e-bc30-0cf5f0561cc9 req-00067e87-4e1d-46ce-a9a9-388278f6f29a tempest-TestStampPattern-1779916837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77e999e2-bd74-4fd5-aa57-ce7310fd6aea', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:10:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-7ae197ff-afd4-470e-bc30-0cf5f0561cc9 req-00067e87-4e1d-46ce-a9a9-388278f6f29a tempest-TestStampPattern-1779916837 None] attachment_update completed successfully.
Nov 05 12:10:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-b11e0f85-2ac3-4522-90d5-ea91759c2b5c req-5db0f44c-9be3-4520-b3f1-5b85e4956145 tempest-TestStampPattern-1779916837 None] Terminate volume connection completed successfully.
Nov 05 12:10:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-b11e0f85-2ac3-4522-90d5-ea91759c2b5c req-5db0f44c-9be3-4520-b3f1-5b85e4956145 tempest-TestStampPattern-1779916837 None] Deleting attachment 77e999e2-bd74-4fd5-aa57-ce7310fd6aea. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Creating offline snapshot bd8ced6a-fa20-45cf-9291-cba97d79ba9a of volume 2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:10:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3656318a-8dee-487e-9b56-0c67341420d1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:33 devstack sudo[105467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f
Nov 05 12:10:33 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:34 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:34 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a 1G
Nov 05 12:10:34 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:34 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a 1G" returned: 0 in 0.407s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:34 devstack sudo[105480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a
Nov 05 12:10:34 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:34 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:34 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a is being set with open permissions: ugo+rw
Nov 05 12:10:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:34 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a
Nov 05 12:10:34 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:35 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a" returned: 0 in 0.252s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:35 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.info
Nov 05 12:10:35 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:35 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.info" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:35 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.info is being set with open permissions: ugo+rw
Nov 05 12:10:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:35 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.info
Nov 05 12:10:35 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:35 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.info" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-55695f98-bf02-4707-943d-8c4c56b1a386 tempest-TestStampPattern-1779916837 None] Create snapshot completed successfully
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Flow 'volume_create_manager' (bbfbbb78-77c5-4681-aca7-ee537de3f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b86321-4b5e-46e3-9315-800bc7b9377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b86321-4b5e-46e3-9315-800bc7b9377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-817914041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdf465c-ad80-4170-8916-731066ffd4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7239bf0ff804ee189f27aea350d034d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd8ced6a-fa20-45cf-9291-cba97d79ba9a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:44Z,use_quota=True,user_id='1a0f566137bd423d8155ccd1af6aced5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05ab073-cf09-4bee-bd42-a32c791fb3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05ab073-cf09-4bee-bd42-a32c791fb3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976234b2-a4a2-4ab0-ba70-31bc5d411a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976234b2-a4a2-4ab0-ba70-31bc5d411a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bdf465c-ad80-4170-8916-731066ffd4ac', 'volume_name': 'volume-7bdf465c-ad80-4170-8916-731066ffd4ac', 'volume_size': 1, 'snapshot_id': 'bd8ced6a-fa20-45cf-9291-cba97d79ba9a'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955266fb-ab94-4ee8-9462-6ade67714a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955266fb-ab94-4ee8-9462-6ade67714a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4818b6-213f-42e1-9934-14a8c45a2b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Volume 7bdf465c-ad80-4170-8916-731066ffd4ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bdf465c-ad80-4170-8916-731066ffd4ac', 'volume_size': 1, 'snapshot_id': 'bd8ced6a-fa20-45cf-9291-cba97d79ba9a'}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-quobyte-bd8ced6a-fa20-45cf-9291-cba97d79ba9a-7bdf465c-ad80-4170-8916-731066ffd4ac" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-bd8ced6a-fa20-45cf-9291-cba97d79ba9a-7bdf465c-ad80-4170-8916-731066ffd4ac" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Creating volume 7bdf465c-ad80-4170-8916-731066ffd4ac from snapshot bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-quobyte-7bdf465c-ad80-4170-8916-731066ffd4ac" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-7bdf465c-ad80-4170-8916-731066ffd4ac" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] snapshot: bd8ced6a-fa20-45cf-9291-cba97d79ba9a, volume: 7bdf465c-ad80-4170-8916-731066ffd4ac,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9bf285-e200-41f0-980f-1e54dbd07ffc]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:44 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a
Nov 05 12:10:44 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:44 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e7dae-1ca9-4d8c-9ae0-37de62d3d84c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:10:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:44 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f
Nov 05 12:10:44 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:45 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" returned: 0 in 0.476s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:45 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac
Nov 05 12:10:45 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:45 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:10:45 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:45 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:10:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:10:54 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:54 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac" returned: 0 in 9.737s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:54 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f, size 1024.00 MB, duration 9.74 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:10:54 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Converted 1024.00 MB image at 105.16 MB/s
Nov 05 12:10:54 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac is being set with open permissions: ugo+rw
Nov 05 12:10:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:55 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac
Nov 05 12:10:55 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:55 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac" returned: 0 in 0.437s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-7bdf465c-ad80-4170-8916-731066ffd4ac" released by "_copy_volume_from_snapshot" :: held 11.222s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-bd8ced6a-fa20-45cf-9291-cba97d79ba9a-7bdf465c-ad80-4170-8916-731066ffd4ac" released by "_create_volume_from_snapshot" :: held 11.367s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.387s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4818b6-213f-42e1-9934-14a8c45a2b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdf465c-ad80-4170-8916-731066ffd4ac', 'volume_size': 1, 'snapshot_id': 'bd8ced6a-fa20-45cf-9291-cba97d79ba9a'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c683f4cc-6799-4c84-98a7-9eb1c9b785a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Volume volume-7bdf465c-ad80-4170-8916-731066ffd4ac (7bdf465c-ad80-4170-8916-731066ffd4ac): created successfully
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c683f4cc-6799-4c84-98a7-9eb1c9b785a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Flow 'volume_create_manager' (bbfbbb78-77c5-4681-aca7-ee537de3f58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:10:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b89f633c-e668-4e79-9a66-c213837512e0 tempest-TestStampPattern-1779916837 None] Created volume successfully.
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Flow 'volume_create_manager' (eb45073e-ccc6-4b45-a45e-80744806d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f27246-190e-40bf-8daa-163186b6155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f27246-190e-40bf-8daa-163186b6155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-482981392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6786ad8c-2735-4e7b-858f-fe055ece4a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5ea04e72e4043a6da7bd5e0742060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:02Z,use_quota=True,user_id='756088bfd12243b1be0fe3d69dc45e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5db1b6e-d71d-4459-a9d6-ccce349b3a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5db1b6e-d71d-4459-a9d6-ccce349b3a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832851b0-9552-4130-b663-f0bc3b07e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832851b0-9552-4130-b663-f0bc3b07e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6786ad8c-2735-4e7b-858f-fe055ece4a36', 'volume_name': 'volume-6786ad8c-2735-4e7b-858f-fe055ece4a36', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaead68-4812-4701-9b1f-f27720ab9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaead68-4812-4701-9b1f-f27720ab9232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ca7b40-b134-407b-944f-9837adf11680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Volume 6786ad8c-2735-4e7b-858f-fe055ece4a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6786ad8c-2735-4e7b-858f-fe055ece4a36', 'volume_size': 1}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-482981392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6786ad8c-2735-4e7b-858f-fe055ece4a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5ea04e72e4043a6da7bd5e0742060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:02Z,use_quota=True,user_id='756088bfd12243b1be0fe3d69dc45e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Creating volume 6786ad8c-2735-4e7b-858f-fe055ece4a36 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:02 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:02 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36 1073741824
Nov 05 12:11:02 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Flow 'volume_create_manager' (6d22de4f-f94d-47b5-85f1-2c22f7914d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b461e8-2eb4-4c9b-b188-14c35fd3e77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b461e8-2eb4-4c9b-b188-14c35fd3e77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1210335582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4a9154-407b-479b-9569-e623ec1035f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5ea04e72e4043a6da7bd5e0742060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:03Z,use_quota=True,user_id='756088bfd12243b1be0fe3d69dc45e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f339260-df03-4335-b4cc-4dc12d6e164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f339260-df03-4335-b4cc-4dc12d6e164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bdcf7a-c470-4402-88e4-511536520598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bdcf7a-c470-4402-88e4-511536520598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4a9154-407b-479b-9569-e623ec1035f5', 'volume_name': 'volume-bc4a9154-407b-479b-9569-e623ec1035f5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3dc9c2-c3c8-449d-bcb2-cc0788f28544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3dc9c2-c3c8-449d-bcb2-cc0788f28544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dedffa2-7cb8-4d3e-b6b0-07105c4b9759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Volume bc4a9154-407b-479b-9569-e623ec1035f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4a9154-407b-479b-9569-e623ec1035f5', 'volume_size': 1}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:03 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36 1073741824" returned: 0 in 0.964s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:03 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36
Nov 05 12:11:03 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:04 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36" returned: 0 in 0.505s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1210335582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4a9154-407b-479b-9569-e623ec1035f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d5ea04e72e4043a6da7bd5e0742060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:03Z,use_quota=True,user_id='756088bfd12243b1be0fe3d69dc45e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Creating volume bc4a9154-407b-479b-9569-e623ec1035f5 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:04 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ca7b40-b134-407b-944f-9837adf11680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6786ad8c-2735-4e7b-858f-fe055ece4a36', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:04 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5 1073741824
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ac8e95-60e2-46a0-9898-521d0bfaf2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:04 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Volume volume-6786ad8c-2735-4e7b-858f-fe055ece4a36 (6786ad8c-2735-4e7b-858f-fe055ece4a36): created successfully
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ac8e95-60e2-46a0-9898-521d0bfaf2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Flow 'volume_create_manager' (eb45073e-ccc6-4b45-a45e-80744806d282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b3f79f87-10c4-497d-9b88-2b1fd4474b4c tempest-TestServerVolumeAttachmentScenario-119547944 None] Created volume successfully.
Nov 05 12:11:04 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5 1073741824" returned: 0 in 0.666s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:04 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5
Nov 05 12:11:04 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:05 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dedffa2-7cb8-4d3e-b6b0-07105c4b9759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4a9154-407b-479b-9569-e623ec1035f5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b7db07-f77d-423e-b8fc-7ea2e40011a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Volume volume-bc4a9154-407b-479b-9569-e623ec1035f5 (bc4a9154-407b-479b-9569-e623ec1035f5): created successfully
Nov 05 12:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b7db07-f77d-423e-b8fc-7ea2e40011a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Flow 'volume_create_manager' (6d22de4f-f94d-47b5-85f1-2c22f7914d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-348a14f7-4277-45b6-889b-0b37c7d15968 tempest-TestServerVolumeAttachmentScenario-119547944 None] Created volume successfully.
Nov 05 12:11:15 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:11:15 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=8,cinder:INSERT=2,cinder:SELECT=3,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:11:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-640191fb-5a66-4d8d-8225-d1b0cf02798e req-8579e8f7-a073-40f6-940f-20b82b05c1fe tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-640191fb-5a66-4d8d-8225-d1b0cf02798e req-8579e8f7-a073-40f6-940f-20b82b05c1fe tempest-TestStampPattern-1779916837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-640191fb-5a66-4d8d-8225-d1b0cf02798e req-8579e8f7-a073-40f6-940f-20b82b05c1fe tempest-TestStampPattern-1779916837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-640191fb-5a66-4d8d-8225-d1b0cf02798e req-8579e8f7-a073-40f6-940f-20b82b05c1fe tempest-TestStampPattern-1779916837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-7bdf465c-ad80-4170-8916-731066ffd4ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d5d9962-fd17-44a9-bedd-876bc6f2794e', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:11:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-640191fb-5a66-4d8d-8225-d1b0cf02798e req-8579e8f7-a073-40f6-940f-20b82b05c1fe tempest-TestStampPattern-1779916837 None] attachment_update completed successfully.
Nov 05 12:11:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-3e550ad0-efcb-4bcc-b3c5-6f01e06d8cd3 req-a74ad27b-7cbf-49a5-ba26-a1cafb5d0774 tempest-TestStampPattern-1779916837 None] Terminate volume connection completed successfully.
Nov 05 12:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-3e550ad0-efcb-4bcc-b3c5-6f01e06d8cd3 req-a74ad27b-7cbf-49a5-ba26-a1cafb5d0774 tempest-TestStampPattern-1779916837 None] Deleting attachment 8d5d9962-fd17-44a9-bedd-876bc6f2794e. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:11:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-7bdf465c-ad80-4170-8916-731066ffd4ac-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Lock "cinder-7bdf465c-ad80-4170-8916-731066ffd4ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-quobyte-7bdf465c-ad80-4170-8916-731066ffd4ac" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-7bdf465c-ad80-4170-8916-731066ffd4ac" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a76c6f-c652-4921-953a-166b489d8976]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:31 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac
Nov 05 12:11:31 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:32 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:32 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac
Nov 05 12:11:32 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:32 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7bdf465c-ad80-4170-8916-731066ffd4ac" returned: 0 in 0.226s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-7bdf465c-ad80-4170-8916-731066ffd4ac" released by "delete_volume" :: held 0.618s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Created reservations ['f85fb640-6880-4336-b65c-036d99ce5a19', '0a0712f5-c401-4f82-832d-951ac81f9d7a', '125bf1ce-acee-4aaa-8a2b-ca79113b2844', '878f56f6-8211-463c-af18-ac9e7ff947f2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:32 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:11:32 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:32 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.238s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:11:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Deleted volume successfully.
Nov 05 12:11:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2268a1fe-10b0-4e80-bd07-da2d5b57ad6b tempest-TestStampPattern-1779916837 None] Lock "cinder-7bdf465c-ad80-4170-8916-731066ffd4ac-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-bd8ced6a-fa20-45cf-9291-cba97d79ba9a-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Lock "cinder-bd8ced6a-fa20-45cf-9291-cba97d79ba9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-quobyte-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-quobyte-bd8ced6a-fa20-45cf-9291-cba97d79ba9a" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-bd8ced6a-fa20-45cf-9291-cba97d79ba9a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Deleting offline snapshot bd8ced6a-fa20-45cf-9291-cba97d79ba9a of volume 2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] snapshot_file for this snap is: volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c179271-38f6-4df1-976f-b7200dc2449b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:33 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a
Nov 05 12:11:33 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:33 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a" returned: 0 in 0.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[628243d8-5cbb-4e0b-85d1-88dec03b477d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:33 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f
Nov 05 12:11:33 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:34 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" returned: 0 in 0.518s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:34 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a
Nov 05 12:11:34 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:34 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a" returned: 0 in 0.355s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:34 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a
Nov 05 12:11:34 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:34 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f.bd8ced6a-fa20-45cf-9291-cba97d79ba9a" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-bd8ced6a-fa20-45cf-9291-cba97d79ba9a" released by "_delete_snapshot" :: held 1.601s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" released by "delete_snapshot" :: held 1.627s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Created reservations ['fe042f53-ac79-44c6-b98c-029b623246e6', '040e43cb-43a7-4a75-9158-8414ba7f6c94', '9d00b5c7-8d2c-498e-8982-1d444b5e2f1a', '1c9c7ac7-3788-49d2-a4e4-f5aad93fd831'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:11:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Delete snapshot completed successfully.
Nov 05 12:11:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fb85530a-2a74-4d38-876e-9839d249a0cb tempest-TestStampPattern-1779916837 None] Lock "cinder-bd8ced6a-fa20-45cf-9291-cba97d79ba9a-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-506ba874-f32f-486c-b629-283c56c7c644 req-cf24d151-3476-4adb-a558-fb45b05e34b4 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-506ba874-f32f-486c-b629-283c56c7c644 req-cf24d151-3476-4adb-a558-fb45b05e34b4 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-506ba874-f32f-486c-b629-283c56c7c644 req-cf24d151-3476-4adb-a558-fb45b05e34b4 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-506ba874-f32f-486c-b629-283c56c7c644 req-cf24d151-3476-4adb-a558-fb45b05e34b4 tempest-TestServerVolumeAttachmentScenario-119547944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-6786ad8c-2735-4e7b-858f-fe055ece4a36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8a94040-ea66-4d90-9ced-a0848bba6fff', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:11:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-506ba874-f32f-486c-b629-283c56c7c644 req-cf24d151-3476-4adb-a558-fb45b05e34b4 tempest-TestServerVolumeAttachmentScenario-119547944 None] attachment_update completed successfully.
Nov 05 12:11:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Lock "cinder-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Acquiring lock "cinder-quobyte-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d8ded0-0d83-4453-9220-327c71da049f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:39 devstack sudo[106810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f
Nov 05 12:11:39 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:39 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:39 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f
Nov 05 12:11:39 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:39 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Lock "cinder-quobyte-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f" released by "delete_volume" :: held 0.748s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Created reservations ['3bd3c6cb-381a-4c45-a6fc-db8081710b2f', '29aa3bb6-4ede-4d0d-97e7-b3630cd75f05', '6077ada6-d94d-464d-9d98-5c085eb472d0', 'a00af4b7-2618-4151-93c5-8cedea2f36b6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-37e8cae7-7694-48ab-91f6-d26fb93519db req-935af8f6-8e59-415e-8472-01f01750af47 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-37e8cae7-7694-48ab-91f6-d26fb93519db req-935af8f6-8e59-415e-8472-01f01750af47 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-37e8cae7-7694-48ab-91f6-d26fb93519db req-935af8f6-8e59-415e-8472-01f01750af47 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-37e8cae7-7694-48ab-91f6-d26fb93519db req-935af8f6-8e59-415e-8472-01f01750af47 tempest-TestServerVolumeAttachmentScenario-119547944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce', 'name': 'volume-bc4a9154-407b-479b-9569-e623ec1035f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4c09693-b95e-4afc-8b06-59f2e8e0189a', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:11:39 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:11:39 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-37e8cae7-7694-48ab-91f6-d26fb93519db req-935af8f6-8e59-415e-8472-01f01750af47 tempest-TestServerVolumeAttachmentScenario-119547944 None] attachment_update completed successfully.
Nov 05 12:11:40 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:11:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Deleted volume successfully.
Nov 05 12:11:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-71b85993-f41d-4fcb-a82e-6d1a4e961978 tempest-TestStampPattern-1779916837 None] Lock "cinder-2dbc405e-5e9d-48a2-9cf8-fbf4588da10f-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-5fb8256a-4491-4e6a-b025-ad40930a77a0 req-3a7d9c2f-c5e7-42d7-a7ad-ce685326d48e tempest-TestServerVolumeAttachmentScenario-119547944 None] Terminate volume connection completed successfully.
Nov 05 12:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-5fb8256a-4491-4e6a-b025-ad40930a77a0 req-3a7d9c2f-c5e7-42d7-a7ad-ce685326d48e tempest-TestServerVolumeAttachmentScenario-119547944 None] Deleting attachment f4c09693-b95e-4afc-8b06-59f2e8e0189a. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:11:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-12d837fd-bba2-4340-9906-23b1e8984879 req-20551874-626f-4395-84d7-2320d47b40d5 tempest-TestServerVolumeAttachmentScenario-119547944 None] Terminate volume connection completed successfully.
Nov 05 12:11:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-12d837fd-bba2-4340-9906-23b1e8984879 req-20551874-626f-4395-84d7-2320d47b40d5 tempest-TestServerVolumeAttachmentScenario-119547944 None] Deleting attachment f8a94040-ea66-4d90-9ced-a0848bba6fff. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:45 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:11:45 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:45 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:11:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:11:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "cinder-bc4a9154-407b-479b-9569-e623ec1035f5-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-bc4a9154-407b-479b-9569-e623ec1035f5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "cinder-quobyte-bc4a9154-407b-479b-9569-e623ec1035f5" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-quobyte-bc4a9154-407b-479b-9569-e623ec1035f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb5fc2-fccb-49dd-822a-0cff2fe246dc]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:47 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5
Nov 05 12:11:47 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:48 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5" returned: 0 in 0.394s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:48 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5
Nov 05 12:11:48 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:48 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bc4a9154-407b-479b-9569-e623ec1035f5" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-quobyte-bc4a9154-407b-479b-9569-e623ec1035f5" released by "delete_volume" :: held 0.694s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Created reservations ['e4736642-e8b7-48b4-8459-864b326c6ad4', '44701ba9-f246-46a1-b90e-97160519b166', 'd4a973dc-51be-49e9-b35e-3f077eb5b85a', 'ff7ea1cd-5ad8-4e6e-9d2f-a13577071223'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:48 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:11:48 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "cinder-6786ad8c-2735-4e7b-858f-fe055ece4a36-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-6786ad8c-2735-4e7b-858f-fe055ece4a36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:48 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:11:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Deleted volume successfully.
Nov 05 12:11:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d715a3b9-d5b3-41f6-a001-4878d6935937 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-bc4a9154-407b-479b-9569-e623ec1035f5-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "cinder-quobyte-6786ad8c-2735-4e7b-858f-fe055ece4a36" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-quobyte-6786ad8c-2735-4e7b-858f-fe055ece4a36" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22386e33-fd3c-4f4b-8874-9b7a70d1817c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:49 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36
Nov 05 12:11:49 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:49 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36" returned: 0 in 0.356s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:49 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36
Nov 05 12:11:49 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:49 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6786ad8c-2735-4e7b-858f-fe055ece4a36" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-quobyte-6786ad8c-2735-4e7b-858f-fe055ece4a36" released by "delete_volume" :: held 0.659s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Created reservations ['843ff189-2c3d-400b-aa03-cfcd07e3b248', '53c976a9-50cd-44d3-b531-6083fb8edbcf', '2fee838d-9529-4150-8249-a37770475855', 'e4aa6fa4-b4d8-486d-ba6a-bb0cd0c95ca4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:49 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:11:49 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:50 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:50 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:11:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Deleted volume successfully.
Nov 05 12:11:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d03b67f-df60-4e27-8010-7b71cd5df566 tempest-TestServerVolumeAttachmentScenario-119547944 None] Lock "cinder-6786ad8c-2735-4e7b-858f-fe055ece4a36-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (9d844820-31a6-4e3c-b1c0-88950ce803e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1884f88d-7f16-485d-b090-8ecdceb3b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1884f88d-7f16-485d-b090-8ecdceb3b468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32038119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9492e236-d21f-46cd-9fb8-9e79a21b6d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:54Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1233134c-0df6-4f68-a488-d14599fbb9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1233134c-0df6-4f68-a488-d14599fbb9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd484428-b7a0-4b32-98c9-9e71e2b7d646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd484428-b7a0-4b32-98c9-9e71e2b7d646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9492e236-d21f-46cd-9fb8-9e79a21b6d2c', 'volume_name': 'volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd6ea2e-c144-468f-846f-0cc3458a3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd6ea2e-c144-468f-846f-0cc3458a3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a909a6b3-be75-4ff8-8004-d436bf11e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume 9492e236-d21f-46cd-9fb8-9e79a21b6d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c', 'volume_size': 1}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32038119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9492e236-d21f-46cd-9fb8-9e79a21b6d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:54Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Creating volume 9492e236-d21f-46cd-9fb8-9e79a21b6d2c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:54 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c 1073741824
Nov 05 12:11:54 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:54 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c 1073741824" returned: 0 in 0.486s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:54 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c
Nov 05 12:11:54 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:55 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c" returned: 0 in 0.271s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:11:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a909a6b3-be75-4ff8-8004-d436bf11e37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf8cf82-7c76-4e55-8dcb-2add6437011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c (9492e236-d21f-46cd-9fb8-9e79a21b6d2c): created successfully
Nov 05 12:11:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf8cf82-7c76-4e55-8dcb-2add6437011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (9d844820-31a6-4e3c-b1c0-88950ce803e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-633afe34-0b97-4b61-b30c-5c24fafc3f3d tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created volume successfully.
Nov 05 12:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (91656bb7-16f5-4f34-89ff-ae695b265f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d393105-bbe8-4d95-a6b7-346c12db1188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d393105-bbe8-4d95-a6b7-346c12db1188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96582795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab794748-8230-4481-81f9-463147a7c2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:57Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e676c9f8-6e6e-496f-b692-98eea1787261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e676c9f8-6e6e-496f-b692-98eea1787261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae5bc2b-c900-479d-8064-a6d280bcf907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae5bc2b-c900-479d-8064-a6d280bcf907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab794748-8230-4481-81f9-463147a7c2c4', 'volume_name': 'volume-ab794748-8230-4481-81f9-463147a7c2c4', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1739edd2-5de2-4c91-82d6-92d8e2980b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1739edd2-5de2-4c91-82d6-92d8e2980b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c18d1d4-98ef-4381-9eaf-aff883f51e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume ab794748-8230-4481-81f9-463147a7c2c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab794748-8230-4481-81f9-463147a7c2c4', 'volume_size': 1}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96582795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab794748-8230-4481-81f9-463147a7c2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:57Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Creating volume ab794748-8230-4481-81f9-463147a7c2c4 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:57 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:57 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4 1073741824
Nov 05 12:11:57 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (3df12934-b7df-4366-b23d-1b94149ae9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f854d1-862a-4c67-a943-e2bc5ecb76df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f854d1-862a-4c67-a943-e2bc5ecb76df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-271266444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6542442d-9b2e-4bbb-9f0d-f84976c4c650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:57Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d49064-2ae2-444a-a9d3-f1b96a3576c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d49064-2ae2-444a-a9d3-f1b96a3576c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cb6f2b-c522-41b3-ae03-8924c933aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cb6f2b-c522-41b3-ae03-8924c933aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6542442d-9b2e-4bbb-9f0d-f84976c4c650', 'volume_name': 'volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2628b465-544e-4392-8503-3781b13f20a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2628b465-544e-4392-8503-3781b13f20a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62e5e9a-e5ea-4eb9-8172-d9c4eef5f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume 6542442d-9b2e-4bbb-9f0d-f84976c4c650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650', 'volume_size': 1}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:57 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4 1073741824" returned: 0 in 0.609s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:57 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4
Nov 05 12:11:57 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (1a0b2a17-04af-41a5-b2ab-8d21ff7d8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6395e121-ad39-4402-88e7-e04de6d86245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6395e121-ad39-4402-88e7-e04de6d86245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795304474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa8be4f-392b-47f9-b310-bed8ccff3a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:58Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ef3e1-829e-4af9-bdbd-23dca5a21e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ef3e1-829e-4af9-bdbd-23dca5a21e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00137975-5d57-45df-a3b0-a0d05a1f40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00137975-5d57-45df-a3b0-a0d05a1f40cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa8be4f-392b-47f9-b310-bed8ccff3a20', 'volume_name': 'volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299fb7f6-494c-46bd-989c-db4105656b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299fb7f6-494c-46bd-989c-db4105656b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db417519-c187-42d4-8100-218d05c5869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume dfa8be4f-392b-47f9-b310-bed8ccff3a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20', 'volume_size': 1}
Nov 05 12:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:58 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-271266444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6542442d-9b2e-4bbb-9f0d-f84976c4c650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:57Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Creating volume 6542442d-9b2e-4bbb-9f0d-f84976c4c650 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c18d1d4-98ef-4381-9eaf-aff883f51e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab794748-8230-4481-81f9-463147a7c2c4', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a15a9d9-3b9c-4501-821f-6e8ee2061218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650 1073741824
Nov 05 12:11:58 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume volume-ab794748-8230-4481-81f9-463147a7c2c4 (ab794748-8230-4481-81f9-463147a7c2c4): created successfully
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a15a9d9-3b9c-4501-821f-6e8ee2061218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (91656bb7-16f5-4f34-89ff-ae695b265f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5f5a24d9-679e-4956-952b-67b225770b4e tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created volume successfully.
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (0ae4c0c0-b7a8-473a-a9c4-4ea80291c749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9bd792-7f55-459a-90b4-9e08afa37191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9bd792-7f55-459a-90b4-9e08afa37191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383435480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43acd8aa-e8d7-4324-bd8a-31cf30b0b179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:58Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13da9b6-558e-4628-ac09-45a217cf5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13da9b6-558e-4628-ac09-45a217cf5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382574fd-f7c3-4c58-b3f6-1c1499f50946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382574fd-f7c3-4c58-b3f6-1c1499f50946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43acd8aa-e8d7-4324-bd8a-31cf30b0b179', 'volume_name': 'volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da88dfc3-25b1-4da3-8d36-f78f6c1d30ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da88dfc3-25b1-4da3-8d36-f78f6c1d30ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99248e4-698b-4745-9414-880e89060b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume 43acd8aa-e8d7-4324-bd8a-31cf30b0b179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179', 'volume_size': 1}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:58 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650 1073741824" returned: 0 in 0.550s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (b27dc6de-3e86-4740-a18f-a2f81a8cd664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd8eaf0-b175-45f2-9401-265fc8196b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd8eaf0-b175-45f2-9401-265fc8196b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-168826111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76da6dec-f57b-4d41-865a-d69391f46c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:59Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1293d90-6a82-43fd-87bb-604cc2f1ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1293d90-6a82-43fd-87bb-604cc2f1ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8d496e-648b-4191-9d80-79c1cc72d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8d496e-648b-4191-9d80-79c1cc72d19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76da6dec-f57b-4d41-865a-d69391f46c43', 'volume_name': 'volume-76da6dec-f57b-4d41-865a-d69391f46c43', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5d0252-5f2c-43a6-9053-bed87051fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5d0252-5f2c-43a6-9053-bed87051fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29711e02-2628-4081-883c-9222ff7d9fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume 76da6dec-f57b-4d41-865a-d69391f46c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76da6dec-f57b-4d41-865a-d69391f46c43', 'volume_size': 1}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:58 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650
Nov 05 12:11:58 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:59 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650" returned: 0 in 0.300s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795304474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa8be4f-392b-47f9-b310-bed8ccff3a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:58Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Creating volume dfa8be4f-392b-47f9-b310-bed8ccff3a20 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:59 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:59 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20 1073741824
Nov 05 12:11:59 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62e5e9a-e5ea-4eb9-8172-d9c4eef5f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af710fd0-5f06-4db5-9b68-4136114c472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650 (6542442d-9b2e-4bbb-9f0d-f84976c4c650): created successfully
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af710fd0-5f06-4db5-9b68-4136114c472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (3df12934-b7df-4366-b23d-1b94149ae9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e39eb44b-7b80-4611-a626-63ba4bedb96f tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created volume successfully.
Nov 05 12:11:59 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20 1073741824" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:59 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20
Nov 05 12:11:59 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:59 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383435480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43acd8aa-e8d7-4324-bd8a-31cf30b0b179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:58Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Creating volume 43acd8aa-e8d7-4324-bd8a-31cf30b0b179 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:59 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db417519-c187-42d4-8100-218d05c5869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:59 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179 1073741824
Nov 05 12:11:59 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3492170f-c802-4df8-a446-6f584ec7fb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20 (dfa8be4f-392b-47f9-b310-bed8ccff3a20): created successfully
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3492170f-c802-4df8-a446-6f584ec7fb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (1a0b2a17-04af-41a5-b2ab-8d21ff7d8d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9e16a547-7429-48e1-8d87-d34023cb2068 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created volume successfully.
Nov 05 12:12:00 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179 1073741824" returned: 0 in 0.464s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:00 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179
Nov 05 12:12:00 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:00 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.933s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-168826111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76da6dec-f57b-4d41-865a-d69391f46c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00163c7441f448a8becb918aabab047c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:59Z,use_quota=True,user_id='4b0359907ba1450c9fb6a54f8b8f7bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Creating volume 76da6dec-f57b-4d41-865a-d69391f46c43 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:00 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:00 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43 1073741824
Nov 05 12:12:00 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99248e4-698b-4745-9414-880e89060b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee056bd-41ee-46e1-b1cf-96204d99b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179 (43acd8aa-e8d7-4324-bd8a-31cf30b0b179): created successfully
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee056bd-41ee-46e1-b1cf-96204d99b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (0ae4c0c0-b7a8-473a-a9c4-4ea80291c749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e8793bba-8dc7-4dba-88cf-f0da07ab2530 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created volume successfully.
Nov 05 12:12:01 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43 1073741824" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:01 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43
Nov 05 12:12:01 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:01 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29711e02-2628-4081-883c-9222ff7d9fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76da6dec-f57b-4d41-865a-d69391f46c43', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e468f4a5-2df5-43e1-b97d-0793e6d02bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Volume volume-76da6dec-f57b-4d41-865a-d69391f46c43 (76da6dec-f57b-4d41-865a-d69391f46c43): created successfully
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e468f4a5-2df5-43e1-b97d-0793e6d02bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Flow 'volume_create_manager' (b27dc6de-3e86-4740-a18f-a2f81a8cd664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8f372c88-bb0f-4421-a1d9-d059781272de tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created volume successfully.
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-76da6dec-f57b-4d41-865a-d69391f46c43-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-76da6dec-f57b-4d41-865a-d69391f46c43-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-quobyte-76da6dec-f57b-4d41-865a-d69391f46c43" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-76da6dec-f57b-4d41-865a-d69391f46c43" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[929e151c-8dfc-41f5-b02f-9337a3f8d119]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:02 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43
Nov 05 12:12:02 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:02 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43" returned: 0 in 0.446s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:02 devstack sudo[106989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43
Nov 05 12:12:02 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:02 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76da6dec-f57b-4d41-865a-d69391f46c43" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-76da6dec-f57b-4d41-865a-d69391f46c43" released by "delete_volume" :: held 0.748s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created reservations ['433c7c7f-6483-45e0-bd8b-823e96d8f93c', '347392fa-afb2-45ed-b15c-4c4f1fc3656f', '9709f0c2-d7ef-45ee-8844-debd78fa5134', '51193e8e-23c8-45dc-9ae4-5be701833a3a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:03 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:03 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-43acd8aa-e8d7-4324-bd8a-31cf30b0b179-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:03 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-43acd8aa-e8d7-4324-bd8a-31cf30b0b179-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Deleted volume successfully.
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-quobyte-43acd8aa-e8d7-4324-bd8a-31cf30b0b179" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-24434499-1947-4aa7-9351-31413be07959 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-76da6dec-f57b-4d41-865a-d69391f46c43-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-43acd8aa-e8d7-4324-bd8a-31cf30b0b179" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c1134-a194-4d02-af35-99c0d259bd2d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:03 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179
Nov 05 12:12:03 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (90c81a2c-6d32-49bc-8ca8-4cffc2ab570a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0835bcdf-63fa-4d64-88b5-c6539f10a901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0835bcdf-63fa-4d64-88b5-c6539f10a901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823522874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3981cc-005c-4fb0-b352-071c69241bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:04Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba07609-211b-4188-af2b-e6cb4aaf3061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba07609-211b-4188-af2b-e6cb4aaf3061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12af23c-0b4c-4777-9941-8a2d5325183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12af23c-0b4c-4777-9941-8a2d5325183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3981cc-005c-4fb0-b352-071c69241bd6', 'volume_name': 'volume-1c3981cc-005c-4fb0-b352-071c69241bd6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922c2636-24ce-483d-9560-574482adaa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922c2636-24ce-483d-9560-574482adaa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0890defc-11a7-46a5-938d-9412a7dae0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Volume 1c3981cc-005c-4fb0-b352-071c69241bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3981cc-005c-4fb0-b352-071c69241bd6', 'volume_size': 1}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823522874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3981cc-005c-4fb0-b352-071c69241bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:04Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Creating volume 1c3981cc-005c-4fb0-b352-071c69241bd6 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:03 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:03 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6 1073741824
Nov 05 12:12:03 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:03 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:03 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179
Nov 05 12:12:03 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (4f3962d2-ecfa-49c4-9acb-24a4ecf6422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bb5c9d-97e5-493f-b2f6-385b65edc1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bb5c9d-97e5-493f-b2f6-385b65edc1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19513597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:04Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9919113-8074-450c-a978-621e38267bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9919113-8074-450c-a978-621e38267bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a20d91-bbcf-4bbd-bcba-7a89b3c585cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a20d91-bbcf-4bbd-bcba-7a89b3c585cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1', 'volume_name': 'volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79abf19-2e62-4255-9162-4463249b678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79abf19-2e62-4255-9162-4463249b678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397ec3b9-2dce-4f3f-b462-47ec68ab10bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Volume 19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1', 'volume_size': 1}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:04 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-43acd8aa-e8d7-4324-bd8a-31cf30b0b179" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-43acd8aa-e8d7-4324-bd8a-31cf30b0b179" released by "delete_volume" :: held 0.888s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:04 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6 1073741824" returned: 0 in 0.652s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created reservations ['fcfe3a51-a3cb-4e59-9b58-e047bf051a42', 'ab58ed21-5af1-4f6c-9deb-4b0f149a9103', 'dd7b8061-6066-4e1c-a953-acc8f86338c3', '41f0a9cc-4bf9-43ab-888f-a36366f03e39'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:04 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6
Nov 05 12:12:04 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:04 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:04 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-dfa8be4f-392b-47f9-b310-bed8ccff3a20-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (53cf5aaf-860b-4599-8ee1-b9f5482d5647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297b04b2-7f91-49d7-9746-248e725fffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297b04b2-7f91-49d7-9746-248e725fffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286997617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87310862-44ea-46ad-800f-49caa08424ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:04Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a806cf-c3b8-4d96-9fe2-d65f47b1c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a806cf-c3b8-4d96-9fe2-d65f47b1c74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e0b865-0b2f-4e4a-adf0-a9f18e3c88f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e0b865-0b2f-4e4a-adf0-a9f18e3c88f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87310862-44ea-46ad-800f-49caa08424ca', 'volume_name': 'volume-87310862-44ea-46ad-800f-49caa08424ca', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a52d9be-9c0c-4e91-94cd-3afb60ceb0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a52d9be-9c0c-4e91-94cd-3afb60ceb0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b3d71b-8247-45e7-bcf5-c63deac9dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Volume 87310862-44ea-46ad-800f-49caa08424ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87310862-44ea-46ad-800f-49caa08424ca', 'volume_size': 1}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-dfa8be4f-392b-47f9-b310-bed8ccff3a20-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-quobyte-dfa8be4f-392b-47f9-b310-bed8ccff3a20" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-dfa8be4f-392b-47f9-b310-bed8ccff3a20" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:04 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19513597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:04Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Creating volume 19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:04 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa21b405-c73f-48f5-9dd2-af75d14e346e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:04 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 1073741824
Nov 05 12:12:04 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0890defc-11a7-46a5-938d-9412a7dae0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3981cc-005c-4fb0-b352-071c69241bd6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:04 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cbe09f-bc12-42b7-af9d-a4edf6a700f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:04 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Deleted volume successfully.
Nov 05 12:12:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Volume volume-1c3981cc-005c-4fb0-b352-071c69241bd6 (1c3981cc-005c-4fb0-b352-071c69241bd6): created successfully
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cbe09f-bc12-42b7-af9d-a4edf6a700f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (90c81a2c-6d32-49bc-8ca8-4cffc2ab570a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e78102bd-05bf-4795-81bf-b1ab92f80f1c tempest-CreateVolumesFromImageTest-1814636003 None] Created volume successfully.
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-182959c8-564f-4b88-b75f-7f25feaedcdf tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-43acd8aa-e8d7-4324-bd8a-31cf30b0b179-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:05 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20
Nov 05 12:12:05 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (bbcf5280-fc27-4513-95a0-edaecdff5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9bb2db-29e2-4455-a068-3f658444ecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9bb2db-29e2-4455-a068-3f658444ecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76620062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef93d452-534c-4451-b87c-71572773fc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:05Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf83c1b-9905-4d32-b1ec-2f2987a1fb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf83c1b-9905-4d32-b1ec-2f2987a1fb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7e119e-8b8a-4c18-a897-28d172ae6fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7e119e-8b8a-4c18-a897-28d172ae6fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef93d452-534c-4451-b87c-71572773fc3c', 'volume_name': 'volume-ef93d452-534c-4451-b87c-71572773fc3c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b48ea73-8a55-4a29-a133-14026b042924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b48ea73-8a55-4a29-a133-14026b042924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0572575b-9df3-427e-88e4-69e2b8c087d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Volume ef93d452-534c-4451-b87c-71572773fc3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef93d452-534c-4451-b87c-71572773fc3c', 'volume_size': 1}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:05 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 1073741824" returned: 0 in 0.588s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:05 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20" returned: 0 in 0.610s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:05 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1
Nov 05 12:12:05 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:05 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20
Nov 05 12:12:05 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (49b4fdf2-89eb-482e-8d32-9fabbb59a22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f8f648-c8e5-4fcb-ace3-672a3e4435a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f8f648-c8e5-4fcb-ace3-672a3e4435a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704816065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180918fe-a671-4879-898c-8950d4b3e932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:06Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fdf891-2704-4994-bff5-f6ac0355fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fdf891-2704-4994-bff5-f6ac0355fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d073ed92-f71b-4157-85bc-204bcca881c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d073ed92-f71b-4157-85bc-204bcca881c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '180918fe-a671-4879-898c-8950d4b3e932', 'volume_name': 'volume-180918fe-a671-4879-898c-8950d4b3e932', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058ace09-d4f4-4f0f-9533-c8cfc9af8397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058ace09-d4f4-4f0f-9533-c8cfc9af8397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ae476c-d115-4422-abb5-ac5dd82c9286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Volume 180918fe-a671-4879-898c-8950d4b3e932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-180918fe-a671-4879-898c-8950d4b3e932', 'volume_size': 1}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:05 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286997617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87310862-44ea-46ad-800f-49caa08424ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:04Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Creating volume 87310862-44ea-46ad-800f-49caa08424ca {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:05 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:05 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca 1073741824
Nov 05 12:12:05 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397ec3b9-2dce-4f3f-b462-47ec68ab10bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03410b-4e45-436e-8ce2-a20f25cf4e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfa8be4f-392b-47f9-b310-bed8ccff3a20" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-dfa8be4f-392b-47f9-b310-bed8ccff3a20" released by "delete_volume" :: held 1.011s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Volume volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 (19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1): created successfully
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03410b-4e45-436e-8ce2-a20f25cf4e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (4f3962d2-ecfa-49c4-9acb-24a4ecf6422b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f47a12df-84f0-47bf-8bae-4de3fc054a73 tempest-CreateVolumesFromImageTest-1814636003 None] Created volume successfully.
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created reservations ['6e2796d4-5b06-498c-a93b-26cd3f0e5325', '52936fea-e208-4c3e-bf69-4b0140d4ec08', 'da49bad3-2aed-42da-9b8b-2d263b7fda23', '3817e991-4d47-4a76-9ff1-7fcb060f9f2f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:05 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:05 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:06 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:06 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca 1073741824" returned: 0 in 0.452s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Deleted volume successfully.
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d133d315-1b6a-4040-a988-eb0fc538a7b4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-dfa8be4f-392b-47f9-b310-bed8ccff3a20-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:06 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca
Nov 05 12:12:06 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:06 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca" returned: 0 in 0.236s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76620062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef93d452-534c-4451-b87c-71572773fc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:05Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Creating volume ef93d452-534c-4451-b87c-71572773fc3c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:06 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:06 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c 1073741824
Nov 05 12:12:06 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b3d71b-8247-45e7-bcf5-c63deac9dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87310862-44ea-46ad-800f-49caa08424ca', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fae01f-9b0e-4a3d-9bb7-84de4dd4fd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Volume volume-87310862-44ea-46ad-800f-49caa08424ca (87310862-44ea-46ad-800f-49caa08424ca): created successfully
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fae01f-9b0e-4a3d-9bb7-84de4dd4fd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (53cf5aaf-860b-4599-8ee1-b9f5482d5647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7f59a77e-c941-40e4-8da8-785a8118596a tempest-CreateVolumesFromImageTest-1814636003 None] Created volume successfully.
Nov 05 12:12:06 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c 1073741824" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-6542442d-9b2e-4bbb-9f0d-f84976c4c650-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-6542442d-9b2e-4bbb-9f0d-f84976c4c650-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:06 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c
Nov 05 12:12:06 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-quobyte-6542442d-9b2e-4bbb-9f0d-f84976c4c650" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-6542442d-9b2e-4bbb-9f0d-f84976c4c650" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2648034-af71-4b94-852a-20d9d78f6694]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:07 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650
Nov 05 12:12:07 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:07 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704816065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180918fe-a671-4879-898c-8950d4b3e932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b7a231d01f4a5b850a799723d77f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:06Z,use_quota=True,user_id='b794ba4cb04d443f849aff6c8986251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Creating volume 180918fe-a671-4879-898c-8950d4b3e932 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:07 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932 1073741824
Nov 05 12:12:07 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0572575b-9df3-427e-88e4-69e2b8c087d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef93d452-534c-4451-b87c-71572773fc3c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f50e157-39c1-4650-813f-59fb00fc37a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Volume volume-ef93d452-534c-4451-b87c-71572773fc3c (ef93d452-534c-4451-b87c-71572773fc3c): created successfully
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f50e157-39c1-4650-813f-59fb00fc37a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (bbcf5280-fc27-4513-95a0-edaecdff5273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4f338229-7444-42c2-a68b-bf2e43417b8f tempest-CreateVolumesFromImageTest-1814636003 None] Created volume successfully.
Nov 05 12:12:07 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:07 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650
Nov 05 12:12:07 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:07 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6542442d-9b2e-4bbb-9f0d-f84976c4c650" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-6542442d-9b2e-4bbb-9f0d-f84976c4c650" released by "delete_volume" :: held 0.736s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:07 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932 1073741824" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:07 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932
Nov 05 12:12:07 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created reservations ['0070b6e9-4b8b-42ae-a997-722aff17a28f', 'b21de309-15c2-4b72-a851-be031f5b13f4', 'fcd6637b-1333-4f58-9524-571449a1bbcf', 'a77cfa7d-3317-40e1-8c25-a3bde05c241f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:07 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:07 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:08 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-ab794748-8230-4481-81f9-463147a7c2c4-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ae476c-d115-4422-abb5-ac5dd82c9286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180918fe-a671-4879-898c-8950d4b3e932', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85a04d7-76fb-46c1-85b0-947a407a35fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-ab794748-8230-4481-81f9-463147a7c2c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Volume volume-180918fe-a671-4879-898c-8950d4b3e932 (180918fe-a671-4879-898c-8950d4b3e932): created successfully
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85a04d7-76fb-46c1-85b0-947a407a35fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Flow 'volume_create_manager' (49b4fdf2-89eb-482e-8d32-9fabbb59a22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e544e78e-d240-4b12-a7fa-1a7315ba2d12 tempest-CreateVolumesFromImageTest-1814636003 None] Created volume successfully.
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-quobyte-ab794748-8230-4481-81f9-463147a7c2c4" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-ab794748-8230-4481-81f9-463147a7c2c4" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:08 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Deleted volume successfully.
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ad0e5-751c-4957-bd25-d3f1bf4d5940]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3c46c56b-2902-4e7f-a239-e116ae1faeb4 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-6542442d-9b2e-4bbb-9f0d-f84976c4c650-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:08 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4
Nov 05 12:12:08 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:08 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:08 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4
Nov 05 12:12:08 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:08 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ab794748-8230-4481-81f9-463147a7c2c4" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-ab794748-8230-4481-81f9-463147a7c2c4" released by "delete_volume" :: held 0.662s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:08 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created reservations ['a371fa60-9fed-4780-9a53-26f26e7c7709', 'bf1e0e1b-099a-4d20-9b36-921330c19805', '82cd3e96-6b03-40c0-96d4-2b163032009d', 'd8bc8b18-96aa-4861-81d9-8884adf0ab29'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-180918fe-a671-4879-898c-8950d4b3e932-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:09 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:09 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-180918fe-a671-4879-898c-8950d4b3e932-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-quobyte-180918fe-a671-4879-898c-8950d4b3e932" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-180918fe-a671-4879-898c-8950d4b3e932" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1741afd4-b32b-46a7-8edd-4750eb6b6fa7]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:09 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932
Nov 05 12:12:09 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:09 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-9492e236-d21f-46cd-9fb8-9e79a21b6d2c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Deleted volume successfully.
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-9492e236-d21f-46cd-9fb8-9e79a21b6d2c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c2727a0f-f553-4f51-8ec5-9dac099800f1 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-ab794748-8230-4481-81f9-463147a7c2c4-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "cinder-quobyte-9492e236-d21f-46cd-9fb8-9e79a21b6d2c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-9492e236-d21f-46cd-9fb8-9e79a21b6d2c" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5347e6-7065-41d4-8ba2-a3fd6e90e853]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:09 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c
Nov 05 12:12:09 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:09 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:09 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932
Nov 05 12:12:09 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:09 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:09 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c
Nov 05 12:12:09 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:09 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-180918fe-a671-4879-898c-8950d4b3e932" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-180918fe-a671-4879-898c-8950d4b3e932" released by "delete_volume" :: held 0.759s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Created reservations ['bb2ccbbe-2115-4359-b763-68418e9e71c0', '770a9aed-1ce3-43d1-b8c4-13843cf7fa97', 'e603f2ec-b14f-4167-9efb-6b82fe0fac3c', '6b0db779-aa1b-42a4-895c-5fa0a997f019'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:10 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:10 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:10 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9492e236-d21f-46cd-9fb8-9e79a21b6d2c" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-quobyte-9492e236-d21f-46cd-9fb8-9e79a21b6d2c" released by "delete_volume" :: held 0.716s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Created reservations ['95188f5a-ddeb-4752-91c3-5606daf85f08', '0161be65-9c57-4d6d-9cae-170d8d35ec4f', '0aa8abf2-70e1-4a32-b0af-fb55e804fc69', '4dbcd09a-fa61-4592-a640-72c43200e024'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-ef93d452-534c-4451-b87c-71572773fc3c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-ef93d452-534c-4451-b87c-71572773fc3c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:10 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.300s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:10 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-quobyte-ef93d452-534c-4451-b87c-71572773fc3c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:10 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Deleted volume successfully.
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-ef93d452-534c-4451-b87c-71572773fc3c" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-773d1117-23b3-457c-9635-89f7305a8b84 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-180918fe-a671-4879-898c-8950d4b3e932-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbbbefb-432f-4244-81d8-57f999bd71ef]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:10 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c
Nov 05 12:12:10 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:10 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Deleted volume successfully.
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46925a50-a396-4857-87f9-df98f7f77466 tempest-CreateVolumesFromSourceVolumeTest-1748525104 None] Lock "cinder-9492e236-d21f-46cd-9fb8-9e79a21b6d2c-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:10 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c" returned: 0 in 0.422s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:10 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c
Nov 05 12:12:10 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:11 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ef93d452-534c-4451-b87c-71572773fc3c" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-ef93d452-534c-4451-b87c-71572773fc3c" released by "delete_volume" :: held 0.727s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Created reservations ['e85fa105-913a-42e0-9959-1538f9ac91b9', 'a25c8d03-9608-4581-9f35-e5df086e7af8', 'b78179f1-1b03-4b0b-99e2-dd48649a5fa3', 'bef6a343-c6f6-428f-9ae5-409b7d2db37c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:11 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:11 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-87310862-44ea-46ad-800f-49caa08424ca-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-87310862-44ea-46ad-800f-49caa08424ca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-quobyte-87310862-44ea-46ad-800f-49caa08424ca" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:11 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-87310862-44ea-46ad-800f-49caa08424ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Deleted volume successfully.
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5670354-2f25-40f2-b3fb-1db35197d16e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-48bb8e35-4406-4392-be24-c12b914c8aed tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-ef93d452-534c-4451-b87c-71572773fc3c-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:11 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca
Nov 05 12:12:11 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:11 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:11 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca
Nov 05 12:12:11 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:12 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-87310862-44ea-46ad-800f-49caa08424ca" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-87310862-44ea-46ad-800f-49caa08424ca" released by "delete_volume" :: held 0.725s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Created reservations ['c9d8e18b-72fa-4cf5-accd-151f54dfe816', 'cfd65c7f-76fc-4db3-9e15-9f797ecf79ed', '45266882-cad9-4869-8737-fb6caaf84d91', 'db84b067-17f8-4f9e-b66a-73f319278155'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:12 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:12 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:12 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Deleted volume successfully.
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-quobyte-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-78415376-fc63-41e1-890b-715eda92eac2 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-87310862-44ea-46ad-800f-49caa08424ca-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49716862-8f2c-46af-a0e9-f452a0097c15]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:12 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1
Nov 05 12:12:12 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:13 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1" returned: 0 in 0.394s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:13 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1
Nov 05 12:12:13 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:13 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1" released by "delete_volume" :: held 0.741s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Created reservations ['37d85091-e580-4773-b922-ddecab6e3528', '6a33a729-6c82-4770-8b45-c114e92619b6', 'e4bfb2ec-7570-4918-ac9c-5a1aed6ef802', 'e72b9921-f1e1-4ab4-b5e2-d7c099cd92bd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:13 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:13 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-1c3981cc-005c-4fb0-b352-071c69241bd6-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-1c3981cc-005c-4fb0-b352-071c69241bd6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "cinder-quobyte-1c3981cc-005c-4fb0-b352-071c69241bd6" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-1c3981cc-005c-4fb0-b352-071c69241bd6" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd78afb-3acf-4fba-92a0-62106aafa888]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:13 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Deleted volume successfully.
Nov 05 12:12:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-624b978d-4049-49fc-8f47-e31db3e2bdb4 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-19eb58a7-e7ae-4c10-9ebc-5a1e3bd6e8d1-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:14 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6
Nov 05 12:12:14 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:14 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:14 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6
Nov 05 12:12:14 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:14 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-1c3981cc-005c-4fb0-b352-071c69241bd6" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-quobyte-1c3981cc-005c-4fb0-b352-071c69241bd6" released by "delete_volume" :: held 0.783s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Created reservations ['b7fccf55-9f99-45b7-8ce7-bb4037ed0a8c', '660f44d9-be16-4799-a256-e2ad3bb91820', '86b3a1a6-9334-4122-9eb6-1da518f2de20', 'a7597dbc-e371-4256-836c-e3c05ae61b5b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:14 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:14 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:15 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:15 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Deleted volume successfully.
Nov 05 12:12:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b8235ff2-9c47-415f-ae37-1de94261c389 tempest-CreateVolumesFromImageTest-1814636003 None] Lock "cinder-1c3981cc-005c-4fb0-b352-071c69241bd6-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=123,cinder:UPDATE=166,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=129,cinder:UPDATE=162,cinder:INSERT=38,cinder:DELETE=14 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (8fada90e-d6af-4843-84a7-3571ed7ecafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51043e76-0a09-4203-ae0b-7d0c8b8f57bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51043e76-0a09-4203-ae0b-7d0c8b8f57bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528820858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576e1e20-062c-4aaf-ae09-554909855432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:18Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62aca8aa-c633-40cc-a1e2-08c0cb23248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62aca8aa-c633-40cc-a1e2-08c0cb23248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfa6a2-2526-4722-9c9b-71c592533c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfa6a2-2526-4722-9c9b-71c592533c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576e1e20-062c-4aaf-ae09-554909855432', 'volume_name': 'volume-576e1e20-062c-4aaf-ae09-554909855432', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa93e59f-671f-4f68-86cf-aaa62ca0eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa93e59f-671f-4f68-86cf-aaa62ca0eee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66649359-e606-4ff0-aaea-a39f4dbe59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume 576e1e20-062c-4aaf-ae09-554909855432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576e1e20-062c-4aaf-ae09-554909855432', 'volume_size': 1}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528820858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576e1e20-062c-4aaf-ae09-554909855432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:18Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Creating volume 576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:18 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 1073741824
Nov 05 12:12:18 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:18 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 1073741824" returned: 0 in 0.492s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:18 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432
Nov 05 12:12:18 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:18 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66649359-e606-4ff0-aaea-a39f4dbe59de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576e1e20-062c-4aaf-ae09-554909855432', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3b8a92-d2d1-40af-9b11-8cfa9a62b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume volume-576e1e20-062c-4aaf-ae09-554909855432 (576e1e20-062c-4aaf-ae09-554909855432): created successfully
Nov 05 12:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3b8a92-d2d1-40af-9b11-8cfa9a62b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (8fada90e-d6af-4843-84a7-3571ed7ecafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-53a5bb13-996b-48bc-93e4-5c42545caf81 tempest-CreateVolumesFromSnapshotTest-825431042 None] Created volume successfully.
Nov 05 12:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Creating offline snapshot 3ab247b0-e149-4e89-856c-400b3ff067af of volume 576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:12:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[562443c6-64e0-4c09-beab-63ecf72b8dbf]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:20 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432
Nov 05 12:12:20 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:20 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:20 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af 1G
Nov 05 12:12:20 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:21 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af 1G" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-576e1e20-062c-4aaf-ae09-554909855432 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:21 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-576e1e20-062c-4aaf-ae09-554909855432 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af
Nov 05 12:12:21 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:21 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-576e1e20-062c-4aaf-ae09-554909855432 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af" returned: 0 in 0.324s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:21 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af is being set with open permissions: ugo+rw
Nov 05 12:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:21 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af
Nov 05 12:12:21 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:21 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:21 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.info
Nov 05 12:12:21 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:22 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.info" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:22 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.info is being set with open permissions: ugo+rw
Nov 05 12:12:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:22 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.info
Nov 05 12:12:22 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:22 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.info" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0b093e7f-9498-49cd-be76-1e39db597eb4 tempest-CreateVolumesFromSnapshotTest-825431042 None] Create snapshot completed successfully
Nov 05 12:12:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (4eba9382-3b32-4976-b5b2-7adb9a58b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43f2c88-0399-40e7-b0ad-a4680ae8d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43f2c88-0399-40e7-b0ad-a4680ae8d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1191969199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46f0d69-3623-4f9b-a892-e5dab9704458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:24Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b46be3-1be4-4417-a44e-55d5acd6ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b46be3-1be4-4417-a44e-55d5acd6ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c430cd6b-579d-457b-a63d-705d2b805040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c430cd6b-579d-457b-a63d-705d2b805040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46f0d69-3623-4f9b-a892-e5dab9704458', 'volume_name': 'volume-f46f0d69-3623-4f9b-a892-e5dab9704458', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789625e8-3a1d-47d6-85e6-a2707834071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789625e8-3a1d-47d6-85e6-a2707834071e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1dbed6-3876-4ce7-896b-cc7f89203823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume f46f0d69-3623-4f9b-a892-e5dab9704458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46f0d69-3623-4f9b-a892-e5dab9704458', 'volume_size': 1}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1191969199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46f0d69-3623-4f9b-a892-e5dab9704458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:24Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Creating volume f46f0d69-3623-4f9b-a892-e5dab9704458 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:24 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:24 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458 1073741824
Nov 05 12:12:24 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (187c8c82-f864-4d9f-b977-ac7dd06cfe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dd475c-26f6-4125-8191-ff4af0b42e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dd475c-26f6-4125-8191-ff4af0b42e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010255198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082676c9-1d20-4587-a809-01fbbfdc0974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:24Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd447b-cb82-4d55-9492-92e5e399bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd447b-cb82-4d55-9492-92e5e399bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d08f21-09d7-459f-80e6-43bb8174e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d08f21-09d7-459f-80e6-43bb8174e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082676c9-1d20-4587-a809-01fbbfdc0974', 'volume_name': 'volume-082676c9-1d20-4587-a809-01fbbfdc0974', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91be55e-8083-40cf-a7e0-bb2fc78e3e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91be55e-8083-40cf-a7e0-bb2fc78e3e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac7cf49-60b6-46a8-b46f-eb8fb7a4241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume 082676c9-1d20-4587-a809-01fbbfdc0974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082676c9-1d20-4587-a809-01fbbfdc0974', 'volume_size': 1}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:24 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458 1073741824" returned: 0 in 0.584s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:24 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458
Nov 05 12:12:24 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (56855ca1-7875-4c3c-af8f-2f818120e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa89d3c3-54ac-4881-8172-1cb08b11bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa89d3c3-54ac-4881-8172-1cb08b11bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654269346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8095fec-1f09-4baa-86c7-ee1c671ccac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:25Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195b2761-55df-4176-a296-d44198d10ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195b2761-55df-4176-a296-d44198d10ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb03919e-3a11-4386-85a9-1c64be83e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb03919e-3a11-4386-85a9-1c64be83e705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8095fec-1f09-4baa-86c7-ee1c671ccac3', 'volume_name': 'volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3277d37c-ad3a-462e-a026-af2ab54110a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3277d37c-ad3a-462e-a026-af2ab54110a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6683ca55-7d65-4d05-8ca3-0a5d899b8a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume a8095fec-1f09-4baa-86c7-ee1c671ccac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3', 'volume_size': 1}
Nov 05 12:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:25 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010255198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082676c9-1d20-4587-a809-01fbbfdc0974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:24Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Creating volume 082676c9-1d20-4587-a809-01fbbfdc0974 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:25 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:25 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974 1073741824
Nov 05 12:12:25 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1dbed6-3876-4ce7-896b-cc7f89203823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46f0d69-3623-4f9b-a892-e5dab9704458', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcb1f2f-9a5b-4c35-a0ed-ae2cd9a16807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume volume-f46f0d69-3623-4f9b-a892-e5dab9704458 (f46f0d69-3623-4f9b-a892-e5dab9704458): created successfully
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcb1f2f-9a5b-4c35-a0ed-ae2cd9a16807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (4eba9382-3b32-4976-b5b2-7adb9a58b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f717aea1-c523-401a-acc5-9af7b971e653 tempest-CreateVolumesFromSnapshotTest-825431042 None] Created volume successfully.
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (3bb10cb8-74b8-4446-8e10-a909e4f73623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51004659-64f1-4f5a-8cde-04da79f82ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51004659-64f1-4f5a-8cde-04da79f82ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705975324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9aae4f-0861-4d0b-855b-8c47f7a464d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:25Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a122f4f1-5e3c-430a-83b6-92abdd4952ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a122f4f1-5e3c-430a-83b6-92abdd4952ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebba0b8-5c97-4b57-adc5-c527ac6a0069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebba0b8-5c97-4b57-adc5-c527ac6a0069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9aae4f-0861-4d0b-855b-8c47f7a464d8', 'volume_name': 'volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eba2540-9903-47dc-9944-d423a81c5dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eba2540-9903-47dc-9944-d423a81c5dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078352fa-faa8-474e-b99c-844b4256b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume 4c9aae4f-0861-4d0b-855b-8c47f7a464d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8', 'volume_size': 1}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:25 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974 1073741824" returned: 0 in 0.601s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (417ee04b-c9d2-430c-86bb-cb925bda99ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be19a88-af44-4467-9d89-236a942e0948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be19a88-af44-4467-9d89-236a942e0948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237066643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6835b475-88c5-404e-acb9-c2135a28646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:26Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f7ec74-342e-43af-9d95-679da77d88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974
Nov 05 12:12:25 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f7ec74-342e-43af-9d95-679da77d88ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8735a639-8839-491b-90c5-e1465581663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8735a639-8839-491b-90c5-e1465581663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6835b475-88c5-404e-acb9-c2135a28646b', 'volume_name': 'volume-6835b475-88c5-404e-acb9-c2135a28646b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5a4e5-d1a5-43b1-8023-6640ce0b1374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5a4e5-d1a5-43b1-8023-6640ce0b1374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ff8401-2781-40d1-9a78-1d0b62da259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume 6835b475-88c5-404e-acb9-c2135a28646b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6835b475-88c5-404e-acb9-c2135a28646b', 'volume_size': 1}
Nov 05 12:12:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:26 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654269346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8095fec-1f09-4baa-86c7-ee1c671ccac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:25Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Creating volume a8095fec-1f09-4baa-86c7-ee1c671ccac3 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:26 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac7cf49-60b6-46a8-b46f-eb8fb7a4241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082676c9-1d20-4587-a809-01fbbfdc0974', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:26 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3 1073741824
Nov 05 12:12:26 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce5278d-0e81-40bf-a1ba-72cf4c354526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume volume-082676c9-1d20-4587-a809-01fbbfdc0974 (082676c9-1d20-4587-a809-01fbbfdc0974): created successfully
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce5278d-0e81-40bf-a1ba-72cf4c354526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (187c8c82-f864-4d9f-b977-ac7dd06cfe13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5e31bba3-b921-4a82-abbe-dca825a0af9f tempest-CreateVolumesFromSnapshotTest-825431042 None] Created volume successfully.
Nov 05 12:12:26 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3 1073741824" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:26 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3
Nov 05 12:12:26 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:26 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705975324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9aae4f-0861-4d0b-855b-8c47f7a464d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:25Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Creating volume 4c9aae4f-0861-4d0b-855b-8c47f7a464d8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:26 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6683ca55-7d65-4d05-8ca3-0a5d899b8a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e2bdfc-694f-4191-be1c-0f2fd7ee5aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:26 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8 1073741824
Nov 05 12:12:26 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3 (a8095fec-1f09-4baa-86c7-ee1c671ccac3): created successfully
Nov 05 12:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e2bdfc-694f-4191-be1c-0f2fd7ee5aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (56855ca1-7875-4c3c-af8f-2f818120e285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a0df7634-cbb1-4f12-a91b-380297f103aa tempest-CreateVolumesFromSnapshotTest-825431042 None] Created volume successfully.
Nov 05 12:12:27 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8 1073741824" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:27 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8
Nov 05 12:12:27 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:27 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237066643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6835b475-88c5-404e-acb9-c2135a28646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed14196df89546c9912564778e47c89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:26Z,use_quota=True,user_id='5d7dcb185bd34da5b673f378e8428334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Creating volume 6835b475-88c5-404e-acb9-c2135a28646b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:27 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078352fa-faa8-474e-b99c-844b4256b572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be11b2f-74bf-4ff2-9250-50e7ed8a36b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:27 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b 1073741824
Nov 05 12:12:27 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8 (4c9aae4f-0861-4d0b-855b-8c47f7a464d8): created successfully
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be11b2f-74bf-4ff2-9250-50e7ed8a36b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (3bb10cb8-74b8-4446-8e10-a909e4f73623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-05fc1521-b1ac-4e2b-9b05-f6276f7a3b6a tempest-CreateVolumesFromSnapshotTest-825431042 None] Created volume successfully.
Nov 05 12:12:28 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b 1073741824" returned: 0 in 0.515s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:28 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b
Nov 05 12:12:28 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:28 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ff8401-2781-40d1-9a78-1d0b62da259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6835b475-88c5-404e-acb9-c2135a28646b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9083a0bd-e5b3-4047-9e43-8bff18882ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Volume volume-6835b475-88c5-404e-acb9-c2135a28646b (6835b475-88c5-404e-acb9-c2135a28646b): created successfully
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9083a0bd-e5b3-4047-9e43-8bff18882ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Flow 'volume_create_manager' (417ee04b-c9d2-430c-86bb-cb925bda99ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6c5ffc35-e5a1-49b7-926b-4dcce17677c7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Created volume successfully.
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-6835b475-88c5-404e-acb9-c2135a28646b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-6835b475-88c5-404e-acb9-c2135a28646b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-6835b475-88c5-404e-acb9-c2135a28646b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-6835b475-88c5-404e-acb9-c2135a28646b" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de8a0ee-115a-49a5-aa43-d9bf104a684a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:29 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b
Nov 05 12:12:29 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:29 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b" returned: 0 in 0.522s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:29 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b
Nov 05 12:12:29 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:30 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6835b475-88c5-404e-acb9-c2135a28646b" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-6835b475-88c5-404e-acb9-c2135a28646b" released by "delete_volume" :: held 0.827s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Created reservations ['4918fdf3-e1d0-44cc-9d29-83a86016e8bc', '8be03e24-0237-47af-b12e-9704166110d2', '37548f2d-8150-4aa6-b1d8-85415731b9ae', 'ca37af03-ec6d-492a-bed3-defc31ff7565'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:30 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:30 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-4c9aae4f-0861-4d0b-855b-8c47f7a464d8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-4c9aae4f-0861-4d0b-855b-8c47f7a464d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-4c9aae4f-0861-4d0b-855b-8c47f7a464d8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-4c9aae4f-0861-4d0b-855b-8c47f7a464d8" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:30 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Deleted volume successfully.
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc65751-3582-486a-8682-a380eb02c6ad]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2ede1a75-47ea-441d-9ea8-ef3968f6b32c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-6835b475-88c5-404e-acb9-c2135a28646b-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:30 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8
Nov 05 12:12:30 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:31 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8" returned: 0 in 0.414s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:31 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8
Nov 05 12:12:31 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:31 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4c9aae4f-0861-4d0b-855b-8c47f7a464d8" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-4c9aae4f-0861-4d0b-855b-8c47f7a464d8" released by "delete_volume" :: held 0.758s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Created reservations ['896f3601-f3b6-45e4-bcaf-334a6c657d6e', '0fb0f498-0c47-45f1-91c9-b8fdb6e3a78c', 'bfd952ec-4ac2-48e0-a161-490f423b809b', 'd28fd7e0-cb14-4748-a7f9-e067b6d56b29'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:31 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:31 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-a8095fec-1f09-4baa-86c7-ee1c671ccac3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-a8095fec-1f09-4baa-86c7-ee1c671ccac3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:31 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-a8095fec-1f09-4baa-86c7-ee1c671ccac3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Deleted volume successfully.
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-a8095fec-1f09-4baa-86c7-ee1c671ccac3" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-21c0de0f-5373-4375-9157-57ddd59c9f80 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-4c9aae4f-0861-4d0b-855b-8c47f7a464d8-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f9fd74-71dd-4735-8087-259b0d98bcaa]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:31 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3
Nov 05 12:12:31 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:32 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3" returned: 0 in 0.439s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:32 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3
Nov 05 12:12:32 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:32 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-a8095fec-1f09-4baa-86c7-ee1c671ccac3" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-a8095fec-1f09-4baa-86c7-ee1c671ccac3" released by "delete_volume" :: held 0.814s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Created reservations ['22873292-cab9-45e0-9862-5dfde3471a3f', 'b275f1cf-a89b-42c9-92c9-62e81eb8a4ab', '581b5105-8f4d-4d94-8ab4-567322d4ae88', 'aff6673d-c163-4c06-a1a9-eb09fec3d2c6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:32 devstack sudo[107305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:32 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-082676c9-1d20-4587-a809-01fbbfdc0974-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-082676c9-1d20-4587-a809-01fbbfdc0974-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-082676c9-1d20-4587-a809-01fbbfdc0974" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-082676c9-1d20-4587-a809-01fbbfdc0974" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9bc58f-a876-4733-a5d4-2f3441b0faf3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:33 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Deleted volume successfully.
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5765496b-013c-422d-9b71-3075232f5dae tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-a8095fec-1f09-4baa-86c7-ee1c671ccac3-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:33 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974
Nov 05 12:12:33 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:33 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974" returned: 0 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:33 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974
Nov 05 12:12:33 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:33 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-082676c9-1d20-4587-a809-01fbbfdc0974" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-082676c9-1d20-4587-a809-01fbbfdc0974" released by "delete_volume" :: held 0.760s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Created reservations ['d625997e-f53c-4cd6-b9bd-61007fd77e4b', 'c4eb2667-84f5-44af-8f06-77052cde0b14', 'fd67f82c-e616-48f2-b616-cfff5e830ee5', 'fb077c4e-439e-44c1-99e0-c8fdf70e8d82'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:34 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:34 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-f46f0d69-3623-4f9b-a892-e5dab9704458-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-f46f0d69-3623-4f9b-a892-e5dab9704458-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:34 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-f46f0d69-3623-4f9b-a892-e5dab9704458" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Deleted volume successfully.
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-f46f0d69-3623-4f9b-a892-e5dab9704458" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db2ecc76-381b-484f-b244-344fc85a79e7 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-082676c9-1d20-4587-a809-01fbbfdc0974-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f599361-d0f5-4399-8b03-2fb10fabfd16]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:34 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458
Nov 05 12:12:34 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:34 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:34 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458
Nov 05 12:12:34 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:35 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f46f0d69-3623-4f9b-a892-e5dab9704458" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-f46f0d69-3623-4f9b-a892-e5dab9704458" released by "delete_volume" :: held 0.755s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Created reservations ['a43a4b1e-854e-4f2d-9df1-bcd3d2f380b4', 'e42db645-1fe2-44c1-bc64-e969d59b2083', '33dee1af-faac-48a3-ad85-7f400eb4a10f', '91e2e539-c61f-47e4-b6ac-8957d52dac59'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:35 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:35 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-3ab247b0-e149-4e89-856c-400b3ff067af-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-3ab247b0-e149-4e89-856c-400b3ff067af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-576e1e20-062c-4aaf-ae09-554909855432" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-576e1e20-062c-4aaf-ae09-554909855432" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-3ab247b0-e149-4e89-856c-400b3ff067af" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-3ab247b0-e149-4e89-856c-400b3ff067af" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Deleting offline snapshot 3ab247b0-e149-4e89-856c-400b3ff067af of volume 576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:12:35 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] snapshot_file for this snap is: volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Deleted volume successfully.
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b01a2b-cf62-4655-a906-a1c207169eeb]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ffef416-9045-4f5d-8de6-43d29e8f65b1 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-f46f0d69-3623-4f9b-a892-e5dab9704458-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:35 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af
Nov 05 12:12:35 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:36 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-576e1e20-062c-4aaf-ae09-554909855432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[52581716-2d48-433d-b725-7264ed72931d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:36 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432
Nov 05 12:12:36 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:36 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:36 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af
Nov 05 12:12:36 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:36 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af" returned: 0 in 0.377s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:36 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af
Nov 05 12:12:36 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Flow 'volume_create_manager' (9fdac39e-ece7-4f80-96a3-f8694f15cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f513d05e-ded2-4544-ad19-d4a039e6c356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:37 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f513d05e-ded2-4544-ad19-d4a039e6c356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1289258457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b410fa7c-e706-4f1d-b98c-1e61e62deff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed53d26896040308526027bfa5d4c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:37Z,use_quota=True,user_id='a921362ec0a94bebb224a54421c39b48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713724ac-564c-484d-b91f-940eb8322fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713724ac-564c-484d-b91f-940eb8322fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04df1c-61f8-4359-8601-bf1f65bba7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04df1c-61f8-4359-8601-bf1f65bba7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b410fa7c-e706-4f1d-b98c-1e61e62deff7', 'volume_name': 'volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7813d65c-2367-400c-9d3b-d4662563e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7813d65c-2367-400c-9d3b-d4662563e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603087f9-f861-4af7-8af0-1eae6a6f863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Volume b410fa7c-e706-4f1d-b98c-1e61e62deff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7', 'volume_size': 1}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1289258457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b410fa7c-e706-4f1d-b98c-1e61e62deff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed53d26896040308526027bfa5d4c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:37Z,use_quota=True,user_id='a921362ec0a94bebb224a54421c39b48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Creating volume b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:37 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432.3ab247b0-e149-4e89-856c-400b3ff067af" returned: 0 in 0.348s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:37 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 1073741824
Nov 05 12:12:37 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-3ab247b0-e149-4e89-856c-400b3ff067af" released by "_delete_snapshot" :: held 1.757s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-576e1e20-062c-4aaf-ae09-554909855432" released by "delete_snapshot" :: held 1.785s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Created reservations ['3dbe9777-1a29-41b7-8534-34024eb86489', 'b5bcb9f8-a556-4102-96dd-7f80543b74fd', '458c9241-5757-4bd9-8fff-f488e569d677', '1d8c4230-afab-4129-a351-d19fef533649'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Delete snapshot completed successfully.
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f0c99020-4a82-4d1b-abd5-7b9e9190684c tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-3ab247b0-e149-4e89-856c-400b3ff067af-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-576e1e20-062c-4aaf-ae09-554909855432-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-576e1e20-062c-4aaf-ae09-554909855432-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "cinder-quobyte-576e1e20-062c-4aaf-ae09-554909855432" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-576e1e20-062c-4aaf-ae09-554909855432" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:37 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 1073741824" returned: 0 in 0.540s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d371a-1b06-46ae-bc85-5c9d04a31678]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:37 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7
Nov 05 12:12:37 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:37 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432
Nov 05 12:12:37 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:38 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603087f9-f861-4af7-8af0-1eae6a6f863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e9d223-db98-42f2-b91b-d19dc36472eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Volume volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 (b410fa7c-e706-4f1d-b98c-1e61e62deff7): created successfully
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e9d223-db98-42f2-b91b-d19dc36472eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Flow 'volume_create_manager' (9fdac39e-ece7-4f80-96a3-f8694f15cd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f8b4e722-bad3-48e4-84c1-c53c3955e607 tempest-SnapshotDependencyTests-366344095 None] Created volume successfully.
Nov 05 12:12:38 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:38 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432
Nov 05 12:12:38 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:38 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-576e1e20-062c-4aaf-ae09-554909855432" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-quobyte-576e1e20-062c-4aaf-ae09-554909855432" released by "delete_volume" :: held 0.737s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Created reservations ['0f05a332-c8a2-4605-a31f-e978b94cf646', '80091f8b-339c-45d0-a6df-a0e923b4978b', '37f2fd2e-2528-4813-b8cf-e18c294bc907', '8d86081f-e5cc-44ed-aa43-e958708da4d5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:38 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:38 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:38 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Deleted volume successfully.
Nov 05 12:12:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59c7e408-c3f3-4080-bebb-f8433841b538 tempest-CreateVolumesFromSnapshotTest-825431042 None] Lock "cinder-576e1e20-062c-4aaf-ae09-554909855432-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Creating offline snapshot 9420dea5-4b5b-48da-be97-548615c6017b of volume b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:12:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef37b6-eff1-43d7-94a8-2e7c797600e8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:39 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7
Nov 05 12:12:39 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:39 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:39 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b 1G
Nov 05 12:12:39 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:40 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b 1G" returned: 0 in 0.459s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:40 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b
Nov 05 12:12:40 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:40 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:40 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b is being set with open permissions: ugo+rw
Nov 05 12:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:40 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b
Nov 05 12:12:40 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:40 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b" returned: 0 in 0.282s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:41 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.info
Nov 05 12:12:41 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:41 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.info" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.info is being set with open permissions: ugo+rw
Nov 05 12:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:41 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.info
Nov 05 12:12:41 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:41 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.info" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-64226a5c-9d26-4e38-b0e3-fc431a6cdf04 tempest-SnapshotDependencyTests-366344095 None] Create snapshot completed successfully
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Flow 'volume_create_manager' (bca0de67-641c-40d6-809d-204b8c731edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b96ff4-6c1c-4ecd-961c-7cfb8ca3a042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b96ff4-6c1c-4ecd-961c-7cfb8ca3a042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103584842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23e4304-240c-479b-8792-dcaf98c373ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ec73ddeb244fea1beb7c420c07631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:42Z,use_quota=True,user_id='6712cc377ecf4062ab5822efb65d16c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c7be52-2a56-48dd-9f33-7c22ea9678ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c7be52-2a56-48dd-9f33-7c22ea9678ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407413bf-12c4-4ccc-bcfe-62f167ee554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407413bf-12c4-4ccc-bcfe-62f167ee554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23e4304-240c-479b-8792-dcaf98c373ff', 'volume_name': 'volume-d23e4304-240c-479b-8792-dcaf98c373ff', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b6285-5c5b-4545-bbf9-f3384bb83be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b6285-5c5b-4545-bbf9-f3384bb83be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd99f37d-3071-4ff6-b382-606fe60910bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Volume d23e4304-240c-479b-8792-dcaf98c373ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23e4304-240c-479b-8792-dcaf98c373ff', 'volume_size': 1}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103584842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23e4304-240c-479b-8792-dcaf98c373ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ec73ddeb244fea1beb7c420c07631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:42Z,use_quota=True,user_id='6712cc377ecf4062ab5822efb65d16c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Creating volume d23e4304-240c-479b-8792-dcaf98c373ff {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:42 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:42 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff 1073741824
Nov 05 12:12:42 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:43 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff 1073741824" returned: 0 in 0.525s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:43 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff
Nov 05 12:12:43 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Flow 'volume_create_manager' (34ef7b9f-45f6-4422-b4b3-d62d4bb8ff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f856ff-1482-49fd-999b-9a0ea540f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f856ff-1482-49fd-999b-9a0ea540f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed53d26896040308526027bfa5d4c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9420dea5-4b5b-48da-be97-548615c6017b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:43Z,use_quota=True,user_id='a921362ec0a94bebb224a54421c39b48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defe196f-61af-4411-aa7b-b86498c177fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defe196f-61af-4411-aa7b-b86498c177fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dd5d1f-96b3-4e76-8034-e6a50d5b1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dd5d1f-96b3-4e76-8034-e6a50d5b1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8', 'volume_name': 'volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8', 'volume_size': 1, 'snapshot_id': '9420dea5-4b5b-48da-be97-548615c6017b'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446b8561-3ae4-4868-abe3-c141df25499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446b8561-3ae4-4868-abe3-c141df25499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48390e01-8ae7-47de-a515-15846bbc272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Volume dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8', 'volume_size': 1, 'snapshot_id': '9420dea5-4b5b-48da-be97-548615c6017b'}
Nov 05 12:12:43 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-quobyte-9420dea5-4b5b-48da-be97-548615c6017b-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd99f37d-3071-4ff6-b382-606fe60910bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23e4304-240c-479b-8792-dcaf98c373ff', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc57a41-6bfd-447a-a4f6-3ce3abf5270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-9420dea5-4b5b-48da-be97-548615c6017b-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Creating volume dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 from snapshot 9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-quobyte-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Volume volume-d23e4304-240c-479b-8792-dcaf98c373ff (d23e4304-240c-479b-8792-dcaf98c373ff): created successfully
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc57a41-6bfd-447a-a4f6-3ce3abf5270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Flow 'volume_create_manager' (bca0de67-641c-40d6-809d-204b8c731edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] snapshot: 9420dea5-4b5b-48da-be97-548615c6017b, volume: dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:12:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9acb556b-49e9-462f-ac08-9f01ab70ca34 tempest-ProjectReaderTests-1493357725 None] Created volume successfully.
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b511b778-d746-420f-83d8-eff26181d90a]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:43 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b
Nov 05 12:12:43 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:43 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3eeec7-de7d-41ce-8c61-9ba124f87b01]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:44 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7
Nov 05 12:12:44 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:44 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:44 devstack sudo[107423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8
Nov 05 12:12:44 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "cinder-d23e4304-240c-479b-8792-dcaf98c373ff-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-d23e4304-240c-479b-8792-dcaf98c373ff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "cinder-quobyte-d23e4304-240c-479b-8792-dcaf98c373ff" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-quobyte-d23e4304-240c-479b-8792-dcaf98c373ff" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[070af44e-3b90-4ea1-91e2-36071bd2941c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:45 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff
Nov 05 12:12:45 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:45 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:45 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:45 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff" returned: 0 in 0.846s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:45 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.430s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:12:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:12:45 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff
Nov 05 12:12:45 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:46 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d23e4304-240c-479b-8792-dcaf98c373ff" returned: 0 in 0.589s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-quobyte-d23e4304-240c-479b-8792-dcaf98c373ff" released by "delete_volume" :: held 1.491s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Created reservations ['344e1fa0-503a-44ba-b0a2-15f3d1ec3601', '2585b271-f4f7-4ffb-899b-7b988545a203', 'efefe4d5-8591-4756-b042-ff9fd12eec28', '59ebb6f8-43cf-40a8-86bf-de958d7f09b5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:46 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:46 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:46 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Deleted volume successfully.
Nov 05 12:12:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3de6844d-77b0-4018-949b-3f1f166bb44b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-d23e4304-240c-479b-8792-dcaf98c373ff-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Flow 'volume_create_manager' (44979495-867e-4017-9a5e-0dbaf62ed7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d69c22-4685-4f9e-82ed-5a390c3499e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d69c22-4685-4f9e-82ed-5a390c3499e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776323877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63abf726-05f6-4c66-818b-7eaf73b1aad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ec73ddeb244fea1beb7c420c07631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:48Z,use_quota=True,user_id='6712cc377ecf4062ab5822efb65d16c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4a220b-a6d7-4655-bc3b-ac86ae06a0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4a220b-a6d7-4655-bc3b-ac86ae06a0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff557d40-e393-40c1-b7ab-03b88dcf97d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff557d40-e393-40c1-b7ab-03b88dcf97d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63abf726-05f6-4c66-818b-7eaf73b1aad9', 'volume_name': 'volume-63abf726-05f6-4c66-818b-7eaf73b1aad9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4745bc2-743f-4f6c-99cb-a767ee31fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4745bc2-743f-4f6c-99cb-a767ee31fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18263106-633f-4907-9bc0-919edf597da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Volume 63abf726-05f6-4c66-818b-7eaf73b1aad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63abf726-05f6-4c66-818b-7eaf73b1aad9', 'volume_size': 1}
Nov 05 12:12:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:51 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" returned: 0 in 6.675s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:12:51 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Converted 1024.00 MB image at 153.39 MB/s
Nov 05 12:12:51 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 is being set with open permissions: ugo+rw
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:51 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8
Nov 05 12:12:51 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:51 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" released by "_copy_volume_from_snapshot" :: held 7.832s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-9420dea5-4b5b-48da-be97-548615c6017b-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" released by "_create_volume_from_snapshot" :: held 7.909s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.939s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.223s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776323877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63abf726-05f6-4c66-818b-7eaf73b1aad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ec73ddeb244fea1beb7c420c07631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:48Z,use_quota=True,user_id='6712cc377ecf4062ab5822efb65d16c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Creating volume 63abf726-05f6-4c66-818b-7eaf73b1aad9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:51 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:51 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9 1073741824
Nov 05 12:12:51 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48390e01-8ae7-47de-a515-15846bbc272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8', 'volume_size': 1, 'snapshot_id': '9420dea5-4b5b-48da-be97-548615c6017b'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3c3a27-b3b9-4f83-a94c-99ac3a7f7354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Volume volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 (dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8): created successfully
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3c3a27-b3b9-4f83-a94c-99ac3a7f7354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Flow 'volume_create_manager' (34ef7b9f-45f6-4422-b4b3-d62d4bb8ff98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-63a32a78-3f01-4791-9a4a-32629c66bf86 tempest-SnapshotDependencyTests-366344095 None] Created volume successfully.
Nov 05 12:12:51 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9 1073741824" returned: 0 in 0.446s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:51 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9
Nov 05 12:12:51 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:52 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18263106-633f-4907-9bc0-919edf597da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63abf726-05f6-4c66-818b-7eaf73b1aad9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50066e57-889f-4bec-97a3-f6d5a5f3cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Volume volume-63abf726-05f6-4c66-818b-7eaf73b1aad9 (63abf726-05f6-4c66-818b-7eaf73b1aad9): created successfully
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50066e57-889f-4bec-97a3-f6d5a5f3cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Flow 'volume_create_manager' (44979495-867e-4017-9a5e-0dbaf62ed7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7f50c5a8-b070-4419-9c10-e4d03d0d569b tempest-ProjectReaderTests-1493357725 None] Created volume successfully.
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-9420dea5-4b5b-48da-be97-548615c6017b-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-9420dea5-4b5b-48da-be97-548615c6017b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-quobyte-b410fa7c-e706-4f1d-b98c-1e61e62deff7" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-b410fa7c-e706-4f1d-b98c-1e61e62deff7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-quobyte-9420dea5-4b5b-48da-be97-548615c6017b" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-9420dea5-4b5b-48da-be97-548615c6017b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Deleting offline snapshot 9420dea5-4b5b-48da-be97-548615c6017b of volume b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] snapshot_file for this snap is: volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ee5795-dccb-4823-adbd-198bff2cb5c8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:52 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b
Nov 05 12:12:52 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:52 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b" returned: 0 in 0.352s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f2d89f-09ec-4df3-bc79-bce8a35f2c5c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:52 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7
Nov 05 12:12:52 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:53 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7" returned: 0 in 0.555s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:53 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b
Nov 05 12:12:53 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "cinder-63abf726-05f6-4c66-818b-7eaf73b1aad9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-63abf726-05f6-4c66-818b-7eaf73b1aad9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "cinder-quobyte-63abf726-05f6-4c66-818b-7eaf73b1aad9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-quobyte-63abf726-05f6-4c66-818b-7eaf73b1aad9" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e12109-57fb-450c-bccb-5f2caf777cc1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:53 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9
Nov 05 12:12:53 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:53 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b" returned: 0 in 0.377s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:53 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b
Nov 05 12:12:53 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:53 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:53 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9
Nov 05 12:12:53 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:53 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7.9420dea5-4b5b-48da-be97-548615c6017b" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-9420dea5-4b5b-48da-be97-548615c6017b" released by "_delete_snapshot" :: held 1.684s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-b410fa7c-e706-4f1d-b98c-1e61e62deff7" released by "delete_snapshot" :: held 1.708s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:53 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Created reservations ['d89c3d4d-6606-4180-bf29-9d2cbdc3b4c3', 'a4e76cf8-bd3f-433a-9283-b0cdb4e32d5a', '07ea2228-61a8-40ab-a8a5-696e86d82b22', '69ded33b-9c5c-42e6-bbd5-983715a15738'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Delete snapshot completed successfully.
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2131eaeb-4a81-477a-8f6f-5885e0209d85 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-9420dea5-4b5b-48da-be97-548615c6017b-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:54 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-63abf726-05f6-4c66-818b-7eaf73b1aad9" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-quobyte-63abf726-05f6-4c66-818b-7eaf73b1aad9" released by "delete_volume" :: held 0.712s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Created reservations ['720d15e8-e002-43bc-bf6f-21fdba2189ab', 'c6aa0dde-ecc2-427b-8610-2f14955dbace', '0e6e0bd4-7062-4666-9c70-f71804ed6916', '2beabbfe-7ec7-4cd0-904c-1452da4a00f5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:54 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:54 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-b410fa7c-e706-4f1d-b98c-1e61e62deff7-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-b410fa7c-e706-4f1d-b98c-1e61e62deff7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-quobyte-b410fa7c-e706-4f1d-b98c-1e61e62deff7" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-b410fa7c-e706-4f1d-b98c-1e61e62deff7" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4785648-e5ab-4af2-8e47-bae7ce99b800]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:54 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Deleted volume successfully.
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cfd1a25d-7be2-4432-856c-ed252586481b tempest-ProjectReaderTests-1493357725 None] Lock "cinder-63abf726-05f6-4c66-818b-7eaf73b1aad9-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:54 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7
Nov 05 12:12:54 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:54 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7" returned: 0 in 0.414s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:54 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7
Nov 05 12:12:54 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:55 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-b410fa7c-e706-4f1d-b98c-1e61e62deff7" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-b410fa7c-e706-4f1d-b98c-1e61e62deff7" released by "delete_volume" :: held 0.770s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Created reservations ['cab4888d-e364-4bec-bc3a-78eb182336d5', '49b2048e-a178-40e6-abbe-a058fdb89274', '7229e5b0-03f9-4dd3-b9e5-9da98dc3eb8e', '9459f8a3-12b5-478a-be68-acffdbd92679'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:55 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:55 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:55 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.341s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "cinder-quobyte-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Deleted volume successfully.
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5b4558c3-69cc-42e4-a4cb-85836dc78d61 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-b410fa7c-e706-4f1d-b98c-1e61e62deff7-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6b5f1-21bf-436e-ae1e-ab286e909dd6]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:55 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8
Nov 05 12:12:55 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:56 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:56 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8
Nov 05 12:12:56 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:56 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-quobyte-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8" released by "delete_volume" :: held 0.749s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Created reservations ['e23c38e3-59db-472b-9e39-51bf655bb581', 'a9508e9d-2dc0-499e-ba98-2f1c5a3a4740', '00a97d67-efca-4dae-98fa-47450d8cb5d3', '7f990015-c143-4aa6-bb70-b226087bdb02'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:56 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:12:56 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:56 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Deleted volume successfully.
Nov 05 12:12:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10cd348b-f263-41f5-bdc8-320a92373116 tempest-SnapshotDependencyTests-366344095 None] Lock "cinder-dfeb8f79-bde0-40ad-9b0d-7ddbf43abbc8-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:06 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=95,cinder:UPDATE=123,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:13:06 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=83,cinder:INSERT=31,cinder:DELETE=10,cinder:UPDATE=124 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:13:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (bb69604c-7803-40bc-98f3-979a4d671e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc9b1ea-72b0-4488-8c90-1238de3c6cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc9b1ea-72b0-4488-8c90-1238de3c6cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254594238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:19Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7e6af1-cfdb-4415-b831-0ae43ff52b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7e6af1-cfdb-4415-b831-0ae43ff52b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96205469-57b0-42b9-a7dd-577f6fbb4d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96205469-57b0-42b9-a7dd-577f6fbb4d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b', 'volume_name': 'volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f641964-7091-4595-b30f-1c8ec1d581a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f641964-7091-4595-b30f-1c8ec1d581a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2c1db4-470b-4b86-b35f-0cc5b3805149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume 76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b', 'volume_size': 1}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254594238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:19Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Creating volume 76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:19 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:19 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b 1073741824
Nov 05 12:13:19 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (cc25cfdf-6992-4da7-9dc1-f631819ae15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a92b83-7d8b-4633-b332-efb68162824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a92b83-7d8b-4633-b332-efb68162824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462205691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c812bc68-514b-49b0-a496-02621b21fe69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:19Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfd18f7-4ade-4454-9f4c-70410cbf747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfd18f7-4ade-4454-9f4c-70410cbf747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904f2d9b-fb3d-40ea-b830-02c21de4ab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904f2d9b-fb3d-40ea-b830-02c21de4ab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c812bc68-514b-49b0-a496-02621b21fe69', 'volume_name': 'volume-c812bc68-514b-49b0-a496-02621b21fe69', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697e1257-ccea-4b17-bc6e-93376fd7effd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697e1257-ccea-4b17-bc6e-93376fd7effd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a2237-5101-44c9-af2e-37744506b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Volume c812bc68-514b-49b0-a496-02621b21fe69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c812bc68-514b-49b0-a496-02621b21fe69', 'volume_size': 1}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (d1047bb3-f89f-48a0-908f-c5a2bf5ace20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d4cd6d-31ac-4b27-9589-aac070bcc9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b 1073741824" returned: 0 in 0.710s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d4cd6d-31ac-4b27-9589-aac070bcc9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204229233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb870818-27a4-49f0-a351-2a5ab6036f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:20Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac83f545-ad93-4a22-be7d-bf05fbde5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac83f545-ad93-4a22-be7d-bf05fbde5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38fffefa-38f9-47a0-8e46-e11ac4264d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38fffefa-38f9-47a0-8e46-e11ac4264d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb870818-27a4-49f0-a351-2a5ab6036f62', 'volume_name': 'volume-cb870818-27a4-49f0-a351-2a5ab6036f62', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc522957-94df-4ebe-ace5-a096d1295f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc522957-94df-4ebe-ace5-a096d1295f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5853ba-e0bf-4ae0-81da-6cc432dfe644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Volume cb870818-27a4-49f0-a351-2a5ab6036f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb870818-27a4-49f0-a351-2a5ab6036f62', 'volume_size': 1}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:19 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b
Nov 05 12:13:19 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (a75b8bfa-c58a-4542-a158-297b968807dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1e8db7-9734-41a8-a21d-f20f55c6f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1e8db7-9734-41a8-a21d-f20f55c6f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467478907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70b57d7-15ff-4ea3-bd30-176ac9a654a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:20Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9916d0-efa4-4810-a105-d469114bc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9916d0-efa4-4810-a105-d469114bc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c22a71-47f2-4302-8c3c-322030c8c288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c22a71-47f2-4302-8c3c-322030c8c288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70b57d7-15ff-4ea3-bd30-176ac9a654a6', 'volume_name': 'volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f464a02-d066-47c6-930c-7441e8850bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f464a02-d066-47c6-930c-7441e8850bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b01e63-559a-46ef-af1a-159eabbc3e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Volume f70b57d7-15ff-4ea3-bd30-176ac9a654a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6', 'volume_size': 1}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:20 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b" returned: 0 in 0.536s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462205691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c812bc68-514b-49b0-a496-02621b21fe69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:19Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Creating volume c812bc68-514b-49b0-a496-02621b21fe69 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:20 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:20 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69 1073741824
Nov 05 12:13:20 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2c1db4-470b-4b86-b35f-0cc5b3805149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e660e3b5-bda6-4e04-97dd-5295a67e846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b (76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b): created successfully
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e660e3b5-bda6-4e04-97dd-5295a67e846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (bb69604c-7803-40bc-98f3-979a4d671e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (f3bdb5cc-3ff7-41ca-bc99-4367dcaa241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55434ee5-49d0-439c-8f24-305dc0667fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dc92f277-06f7-4f28-b95b-2e3c0d15a27d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created volume successfully.
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55434ee5-49d0-439c-8f24-305dc0667fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242947072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc0442d-ec69-4971-a8c9-1cde133f92d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:20Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b26acf-6363-49e7-8197-d12db770024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b26acf-6363-49e7-8197-d12db770024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb73e5b-548a-4c7c-87fe-57387c3b8ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb73e5b-548a-4c7c-87fe-57387c3b8ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc0442d-ec69-4971-a8c9-1cde133f92d2', 'volume_name': 'volume-efc0442d-ec69-4971-a8c9-1cde133f92d2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6885c-5233-4da0-a883-8e3cf92ecfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6885c-5233-4da0-a883-8e3cf92ecfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577dec81-806f-4aa1-9df3-6d0aa3572e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Volume efc0442d-ec69-4971-a8c9-1cde133f92d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc0442d-ec69-4971-a8c9-1cde133f92d2', 'volume_size': 1}
Nov 05 12:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (33fac57e-25bd-4f01-ba47-03282363862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a226e-65bc-4785-a02a-7d5480b3b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a226e-65bc-4785-a02a-7d5480b3b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125678418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:21Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c07bffe-9c44-4b50-8f45-47f0cb8401c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c07bffe-9c44-4b50-8f45-47f0cb8401c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194acf14-f8a1-443e-a8ed-11e092c1e838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194acf14-f8a1-443e-a8ed-11e092c1e838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6', 'volume_name': 'volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73662f7f-ceee-4ced-b452-ad4b4db02735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73662f7f-ceee-4ced-b452-ad4b4db02735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0458adf7-ad5d-4b3b-b9df-2409e00e7333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:21 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Volume 4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6', 'volume_size': 1}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:21 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69 1073741824" returned: 0 in 0.787s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:21 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69
Nov 05 12:13:21 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:21 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204229233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb870818-27a4-49f0-a351-2a5ab6036f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:20Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Creating volume cb870818-27a4-49f0-a351-2a5ab6036f62 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:21 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:21 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62 1073741824
Nov 05 12:13:21 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a2237-5101-44c9-af2e-37744506b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c812bc68-514b-49b0-a496-02621b21fe69', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7283db9-60b7-4064-929c-9bdae4f7db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (008e595b-1dcd-43c5-ae50-137524a0da3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c8cc42-5ee8-40d5-b533-e2c5021129cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:21 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Volume volume-c812bc68-514b-49b0-a496-02621b21fe69 (c812bc68-514b-49b0-a496-02621b21fe69): created successfully
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7283db9-60b7-4064-929c-9bdae4f7db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (cc25cfdf-6992-4da7-9dc1-f631819ae15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c8cc42-5ee8-40d5-b533-e2c5021129cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235258409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cac8378-d191-438e-9455-407641115f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:22Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c0f4d-1bf4-4532-91cc-4de7ba378ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c0f4d-1bf4-4532-91cc-4de7ba378ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d26750-7429-48a2-89d7-23746448aebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d26750-7429-48a2-89d7-23746448aebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cac8378-d191-438e-9455-407641115f95', 'volume_name': 'volume-7cac8378-d191-438e-9455-407641115f95', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fded95-3f0f-4735-9c28-e02c2a6e311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fded95-3f0f-4735-9c28-e02c2a6e311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76449d37-9764-4653-bb62-df6a9568cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume 7cac8378-d191-438e-9455-407641115f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cac8378-d191-438e-9455-407641115f95', 'volume_size': 1}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9b304fa3-b3b7-4786-be11-f056135068ba tempest-CreateVolumesFromImageTest-1917121074 None] Created volume successfully.
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (4a73bbdc-e916-457d-b3ea-e8ca9569767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4233b867-f27b-49a1-8924-da7e7f30a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4233b867-f27b-49a1-8924-da7e7f30a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-724219886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4aab4a8-80a9-484b-9b3b-32d7e454934e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:22Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18901a4-9ff1-4d2c-b590-8b5ebe863b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18901a4-9ff1-4d2c-b590-8b5ebe863b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8085000d-4eb4-4c25-b6a1-12c71b030c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8085000d-4eb4-4c25-b6a1-12c71b030c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4aab4a8-80a9-484b-9b3b-32d7e454934e', 'volume_name': 'volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99dc937-4ef7-4eb5-9c2e-d847bb6a2331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99dc937-4ef7-4eb5-9c2e-d847bb6a2331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9a883c-e009-4d3a-a20a-5bf56a2c87e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume f4aab4a8-80a9-484b-9b3b-32d7e454934e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e', 'volume_size': 1}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62 1073741824" returned: 0 in 0.782s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:22 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62
Nov 05 12:13:22 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:22 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467478907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70b57d7-15ff-4ea3-bd30-176ac9a654a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:20Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Creating volume f70b57d7-15ff-4ea3-bd30-176ac9a654a6 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:22 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5853ba-e0bf-4ae0-81da-6cc432dfe644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb870818-27a4-49f0-a351-2a5ab6036f62', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:22 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6 1073741824
Nov 05 12:13:22 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da49bbaf-88d5-4154-8991-71b074c4bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (798db50a-10e7-4be2-b11f-f34bea39048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d9be25-9743-4228-ae66-ec0e1c6d12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Volume volume-cb870818-27a4-49f0-a351-2a5ab6036f62 (cb870818-27a4-49f0-a351-2a5ab6036f62): created successfully
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da49bbaf-88d5-4154-8991-71b074c4bd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (d1047bb3-f89f-48a0-908f-c5a2bf5ace20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d9be25-9743-4228-ae66-ec0e1c6d12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493353781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7afde85-c494-4a2f-90a8-fac1e9aecad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:23Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551e5d1d-366a-4bb2-8f68-5eb1147cd97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551e5d1d-366a-4bb2-8f68-5eb1147cd97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4904bde-cf3e-4ce2-b6d6-3ce10396c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4904bde-cf3e-4ce2-b6d6-3ce10396c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7afde85-c494-4a2f-90a8-fac1e9aecad7', 'volume_name': 'volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368fb9d8-2703-4d62-b159-ff7c653f866f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368fb9d8-2703-4d62-b159-ff7c653f866f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37e891f-e847-4719-9109-94319de26ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume c7afde85-c494-4a2f-90a8-fac1e9aecad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7', 'volume_size': 1}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dae6c228-d73e-495d-b94b-fb72ca09afb6 tempest-CreateVolumesFromImageTest-1917121074 None] Created volume successfully.
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (6e03f906-ba9e-4af6-8951-b4651f5b1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7376e3d-967e-4625-8129-f8018f6489a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7376e3d-967e-4625-8129-f8018f6489a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056993630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f261672f-b769-4b30-a52f-02f951ae28cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:23Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bb9337-d9bc-4b35-ad7b-e3958da4ae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bb9337-d9bc-4b35-ad7b-e3958da4ae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c660bf-75af-4f80-8439-e57a74dcdc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c660bf-75af-4f80-8439-e57a74dcdc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f261672f-b769-4b30-a52f-02f951ae28cd', 'volume_name': 'volume-f261672f-b769-4b30-a52f-02f951ae28cd', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c87e8f-0c33-49f8-8615-87d0b14b24a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c87e8f-0c33-49f8-8615-87d0b14b24a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5113baa4-9d29-4225-9c4d-61eaabd73e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume f261672f-b769-4b30-a52f-02f951ae28cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f261672f-b769-4b30-a52f-02f951ae28cd', 'volume_size': 1}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6 1073741824" returned: 0 in 0.731s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:23 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6
Nov 05 12:13:23 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (04531bef-c1ec-4374-87e0-6cc18885ecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa0d9a8-ce1d-41cd-a8bf-3c68df134c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa0d9a8-ce1d-41cd-a8bf-3c68df134c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234259310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b52308-3706-4eb8-a15c-b4e45f91dd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:24Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e01a89-e3c5-4975-b954-0f050a02392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e01a89-e3c5-4975-b954-0f050a02392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d504b9-a34e-47ff-bfce-0b889cbf78c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d504b9-a34e-47ff-bfce-0b889cbf78c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b52308-3706-4eb8-a15c-b4e45f91dd58', 'volume_name': 'volume-83b52308-3706-4eb8-a15c-b4e45f91dd58', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6553b923-5968-4ae1-932e-79a479ba3bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6553b923-5968-4ae1-932e-79a479ba3bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e3990e-c742-4e36-81e1-09010f48440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume 83b52308-3706-4eb8-a15c-b4e45f91dd58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b52308-3706-4eb8-a15c-b4e45f91dd58', 'volume_size': 1}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:24 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.384s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242947072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc0442d-ec69-4971-a8c9-1cde133f92d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:20Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Creating volume efc0442d-ec69-4971-a8c9-1cde133f92d2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:24 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b01e63-559a-46ef-af1a-159eabbc3e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68c2a97-6c5a-4d1e-b35c-8694721c61f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:24 devstack sudo[107631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2 1073741824
Nov 05 12:13:24 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Volume volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6 (f70b57d7-15ff-4ea3-bd30-176ac9a654a6): created successfully
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68c2a97-6c5a-4d1e-b35c-8694721c61f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (a75b8bfa-c58a-4542-a158-297b968807dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c7276a2b-3224-49d5-960f-6564fbe6bcb5 tempest-CreateVolumesFromImageTest-1917121074 None] Created volume successfully.
Nov 05 12:13:24 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2 1073741824" returned: 0 in 0.618s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:24 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2
Nov 05 12:13:24 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:25 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.926s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125678418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f9b1ec310140f095f020ae33e53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:21Z,use_quota=True,user_id='1fcebd68ddca4ec69c92347c563ff5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Creating volume 4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:25 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577dec81-806f-4aa1-9df3-6d0aa3572e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc0442d-ec69-4971-a8c9-1cde133f92d2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb515fc-1140-43aa-8711-7c13ffb6f1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 1073741824
Nov 05 12:13:25 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Volume volume-efc0442d-ec69-4971-a8c9-1cde133f92d2 (efc0442d-ec69-4971-a8c9-1cde133f92d2): created successfully
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb515fc-1140-43aa-8711-7c13ffb6f1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (f3bdb5cc-3ff7-41ca-bc99-4367dcaa241c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a6b74980-a89c-472e-8a4c-1935d0971349 tempest-CreateVolumesFromImageTest-1917121074 None] Created volume successfully.
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Flow 'volume_create_manager' (7b130b19-b385-4815-9fc5-038951d879d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfcfd86-1890-4e74-8325-399d1ff1ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfcfd86-1890-4e74-8325-399d1ff1ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06738577-e6b0-43c6-903e-937cc0d967fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d984707b54ae3bf9f6060332a0bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:26Z,use_quota=True,user_id='9fd85562b521437fb606e0f6205305cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dca59abc-36ba-4610-88c8-fd59935f6d6a),volume_type_id=dca59abc-36ba-4610-88c8-fd59935f6d6a)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85f8d08-5abb-4b48-a9f0-046ca0538340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85f8d08-5abb-4b48-a9f0-046ca0538340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75005975-2ae6-4934-ba66-c67f380d954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 1073741824" returned: 0 in 0.624s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:25 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6
Nov 05 12:13:25 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:26 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.985s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235258409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cac8378-d191-438e-9455-407641115f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:22Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Creating volume 7cac8378-d191-438e-9455-407641115f95 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:26 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0458adf7-ad5d-4b3b-b9df-2409e00e7333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95 1073741824
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f6d692-6f90-4f63-bdc5-d20573d5f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Volume volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 (4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6): created successfully
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f6d692-6f90-4f63-bdc5-d20573d5f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Flow 'volume_create_manager' (33fac57e-25bd-4f01-ba47-03282363862a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-64819a10-f06b-4528-875b-76fcea509ae7 tempest-CreateVolumesFromImageTest-1917121074 None] Created volume successfully.
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75005975-2ae6-4934-ba66-c67f380d954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06738577-e6b0-43c6-903e-937cc0d967fe', 'volume_name': 'volume-06738577-e6b0-43c6-903e-937cc0d967fe', 'volume_size': 1, 'image_id': 'c82b74cf-e420-4e86-9bf6-da1e907313e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c82b74cf-e420-4e86-9bf6-da1e907313e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c441c9d90e0bd6f4b87e43e148b4a9f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e9d984707b54ae3bf9f6060332a0bd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f1cf06d298b72c99d64948b3b7534d2c06195482fdfe11cad108ed0ece38744f0bb6d32a4816ae0328ea21339a50a1b9fdb77e413c23ab72eef9b6b29608e79', 'id': 'c82b74cf-e420-4e86-9bf6-da1e907313e6', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c82b74cf-e420-4e86-9bf6-da1e907313e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea5e20>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b21e51-b6fe-4d78-b995-35641bd536c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b21e51-b6fe-4d78-b995-35641bd536c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069b7b1f-7ad0-4ea4-a5da-a12add6bc3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Volume 06738577-e6b0-43c6-903e-937cc0d967fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06738577-e6b0-43c6-903e-937cc0d967fe', 'volume_size': 1, 'image_id': 'c82b74cf-e420-4e86-9bf6-da1e907313e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c82b74cf-e420-4e86-9bf6-da1e907313e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c441c9d90e0bd6f4b87e43e148b4a9f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e9d984707b54ae3bf9f6060332a0bd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f1cf06d298b72c99d64948b3b7534d2c06195482fdfe11cad108ed0ece38744f0bb6d32a4816ae0328ea21339a50a1b9fdb77e413c23ab72eef9b6b29608e79', 'id': 'c82b74cf-e420-4e86-9bf6-da1e907313e6', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c82b74cf-e420-4e86-9bf6-da1e907313e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea5e20>}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Trying to clone 06738577-e6b0-43c6-903e-937cc0d967fe from image c82b74cf-e420-4e86-9bf6-da1e907313e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c82b74cf-e420-4e86-9bf6-da1e907313e6', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:13:26 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e22f94-dc0a-46e3-b778-a2503d60c83a]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:26 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95 1073741824" returned: 0 in 0.537s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:26 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD
Nov 05 12:13:26 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:26 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95
Nov 05 12:13:26 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:26 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-quobyte-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab9f4e-3a61-4e77-a31c-f3ec0df817b6]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:27 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD
Nov 05 12:13:27 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:27 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.612s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-724219886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4aab4a8-80a9-484b-9b3b-32d7e454934e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:22Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Creating volume f4aab4a8-80a9-484b-9b3b-32d7e454934e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:27 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:27 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6
Nov 05 12:13:27 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:27 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e 1073741824
Nov 05 12:13:27 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76449d37-9764-4653-bb62-df6a9568cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cac8378-d191-438e-9455-407641115f95', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397a33d3-1822-451b-9ea9-a3ab73c0eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume volume-7cac8378-d191-438e-9455-407641115f95 (7cac8378-d191-438e-9455-407641115f95): created successfully
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397a33d3-1822-451b-9ea9-a3ab73c0eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (008e595b-1dcd-43c5-ae50-137524a0da3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-546df86e-106d-4e22-90de-010ece34ba66 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created volume successfully.
Nov 05 12:13:27 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Temporary image c82b74cf-e420-4e86-9bf6-da1e907313e6 is fetched for user 9fd85562b521437fb606e0f6205305cc. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db49ecb-637c-4e73-9965-ff6057766681]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:27 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6" returned: 0 in 0.500s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:27 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6
Nov 05 12:13:27 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:27 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD
Nov 05 12:13:27 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:27 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e 1073741824" returned: 0 in 0.629s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:27 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e
Nov 05 12:13:27 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:27 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6" released by "delete_volume" :: held 0.885s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Created reservations ['9c647876-1e1b-425e-8eec-68015956e2f7', 'a5ddbce0-00a1-4e7d-a47c-bdd561483791', '4e031c59-37b7-4b8d-83e2-93acb0c64f7d', '8b04e553-3a8e-4a38-b7b5-d9f3cfa072a3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:27 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:28 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:28 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:28 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-efc0442d-ec69-4971-a8c9-1cde133f92d2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:28 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD
Nov 05 12:13:28 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.960s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493353781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7afde85-c494-4a2f-90a8-fac1e9aecad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:23Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Creating volume c7afde85-c494-4a2f-90a8-fac1e9aecad7 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:28 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:28 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7 1073741824
Nov 05 12:13:28 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-efc0442d-ec69-4971-a8c9-1cde133f92d2-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9a883c-e009-4d3a-a20a-5bf56a2c87e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8719c007-838e-4c8a-a68f-7cbb7ce9acd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e (f4aab4a8-80a9-484b-9b3b-32d7e454934e): created successfully
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8719c007-838e-4c8a-a68f-7cbb7ce9acd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (4a73bbdc-e916-457d-b3ea-e8ca9569767f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ee212be6-6c78-40cb-852e-fae24583533e tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created volume successfully.
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-quobyte-efc0442d-ec69-4971-a8c9-1cde133f92d2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-efc0442d-ec69-4971-a8c9-1cde133f92d2" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d12dd2c-ca2d-4ed8-beb0-5256a371f72b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:28 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Deleted volume successfully.
Nov 05 12:13:28 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dfeb3911-8a51-4c2f-99db-cd0d82599b7b tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-4eb3a2de-4a8e-4d75-afc6-9518e7fc03f6-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD" returned: 1 in 0.521s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:28 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2
Nov 05 12:13:28 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:28 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7 1073741824" returned: 0 in 0.607s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:28 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7
Nov 05 12:13:28 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:28 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:28 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2
Nov 05 12:13:28 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:29 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.412s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056993630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f261672f-b769-4b30-a52f-02f951ae28cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:23Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Creating volume f261672f-b769-4b30-a52f-02f951ae28cd {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:29 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37e891f-e847-4719-9109-94319de26ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:29 devstack sudo[107714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd 1073741824
Nov 05 12:13:29 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cc1e4d-dcf1-4d8d-9f96-602abfd780f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7 (c7afde85-c494-4a2f-90a8-fac1e9aecad7): created successfully
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cc1e4d-dcf1-4d8d-9f96-602abfd780f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (798db50a-10e7-4be2-b11f-f34bea39048e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-96b3fc54-33f0-48dd-b357-ca524f80cfb1 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created volume successfully.
Nov 05 12:13:29 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-efc0442d-ec69-4971-a8c9-1cde133f92d2" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-efc0442d-ec69-4971-a8c9-1cde133f92d2" released by "delete_volume" :: held 0.871s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Created reservations ['2ad9e6fa-4f40-433f-ac1f-9fb16c35c2fa', '50f9e32d-2fd2-4e3f-a01f-dfc72c00ffca', '3675fefc-0f40-4863-b0a6-f48fe3537656', 'b94e850e-3e2c-4fdc-aae0-583d1f1110a6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:29 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:29 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:29 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:29 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd 1073741824" returned: 0 in 0.608s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.312s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Deleted volume successfully.
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d639bfe2-9cb5-4a3e-a837-293f02361232 tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-efc0442d-ec69-4971-a8c9-1cde133f92d2-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:29 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd
Nov 05 12:13:29 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:30 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.927s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234259310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b52308-3706-4eb8-a15c-b4e45f91dd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a8de61a7a465c8a9da4963e9b1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:24Z,use_quota=True,user_id='28e6f5ed18a74718aaaf530d13a28418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Creating volume 83b52308-3706-4eb8-a15c-b4e45f91dd58 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:30 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5113baa4-9d29-4225-9c4d-61eaabd73e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f261672f-b769-4b30-a52f-02f951ae28cd', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:30 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58 1073741824
Nov 05 12:13:30 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7066976-7198-4a89-a7f8-19ed37802a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume volume-f261672f-b769-4b30-a52f-02f951ae28cd (f261672f-b769-4b30-a52f-02f951ae28cd): created successfully
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7066976-7198-4a89-a7f8-19ed37802a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (6e03f906-ba9e-4af6-8951-b4651f5b1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-47fb0ae9-9838-41a6-ab29-4494d6c6d4be tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created volume successfully.
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-f70b57d7-15ff-4ea3-bd30-176ac9a654a6-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-f70b57d7-15ff-4ea3-bd30-176ac9a654a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-quobyte-f70b57d7-15ff-4ea3-bd30-176ac9a654a6" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-f70b57d7-15ff-4ea3-bd30-176ac9a654a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0ff2be-928e-40bf-b7c8-f44fcc85815d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:30 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58 1073741824" returned: 0 in 0.519s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:30 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6
Nov 05 12:13:30 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:30 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58
Nov 05 12:13:30 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:30 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6" returned: 0 in 0.430s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:30 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58" returned: 0 in 0.328s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.442s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06738577-e6b0-43c6-903e-937cc0d967fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d984707b54ae3bf9f6060332a0bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:26Z,use_quota=True,user_id='9fd85562b521437fb606e0f6205305cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dca59abc-36ba-4610-88c8-fd59935f6d6a),volume_type_id=dca59abc-36ba-4610-88c8-fd59935f6d6a)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Creating volume 06738577-e6b0-43c6-903e-937cc0d967fe {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:30 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6
Nov 05 12:13:30 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:30 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e3990e-c742-4e36-81e1-09010f48440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b52308-3706-4eb8-a15c-b4e45f91dd58', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:30 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe 1073741824
Nov 05 12:13:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153030d0-e810-4897-8da9-45db817bfa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:31 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:31 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Volume volume-83b52308-3706-4eb8-a15c-b4e45f91dd58 (83b52308-3706-4eb8-a15c-b4e45f91dd58): created successfully
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153030d0-e810-4897-8da9-45db817bfa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Flow 'volume_create_manager' (04531bef-c1ec-4374-87e0-6cc18885ecfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-444bc93a-f1c4-4a2d-9f3f-29ae25d3c6b6 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created volume successfully.
Nov 05 12:13:31 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f70b57d7-15ff-4ea3-bd30-176ac9a654a6" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-f70b57d7-15ff-4ea3-bd30-176ac9a654a6" released by "delete_volume" :: held 0.785s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Created reservations ['a69b73f6-2a44-4613-9b73-686da0735158', '4f321aeb-5cfa-450b-b224-c6fbdd0dd7d0', 'dda41fc1-cab6-4fab-ac63-7f96d8219975', '94e9f5a9-6ba3-451d-b367-75308fdadb4f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:31 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:31 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:31 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe 1073741824" returned: 0 in 0.560s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:31 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe
Nov 05 12:13:31 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-cb870818-27a4-49f0-a351-2a5ab6036f62-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-cb870818-27a4-49f0-a351-2a5ab6036f62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-quobyte-cb870818-27a4-49f0-a351-2a5ab6036f62" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-cb870818-27a4-49f0-a351-2a5ab6036f62" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a328feb-6f01-45ff-a1ef-88a5bcb927e2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:31 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Deleted volume successfully.
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b72a1149-68ee-42db-88fd-84f80b41a2eb tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-f70b57d7-15ff-4ea3-bd30-176ac9a654a6-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-83b52308-3706-4eb8-a15c-b4e45f91dd58-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-83b52308-3706-4eb8-a15c-b4e45f91dd58-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:31 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62
Nov 05 12:13:31 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:31 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-quobyte-83b52308-3706-4eb8-a15c-b4e45f91dd58" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe" returned: 0 in 0.429s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-83b52308-3706-4eb8-a15c-b4e45f91dd58" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Attempting download of c82b74cf-e420-4e86-9bf6-da1e907313e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c82b74cf-e420-4e86-9bf6-da1e907313e6', 'metadata': {}}])) to volume 06738577-e6b0-43c6-903e-937cc0d967fe. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42c96ed-4bbf-47ef-a0c7-3cfa4d36af01]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[84edbbc3-734c-4647-9e76-2f4b721ba778]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c82b74cf-e420-4e86-9bf6-da1e907313e6_sou6_hq8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58
Nov 05 12:13:32 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack sudo[107760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c82b74cf-e420-4e86-9bf6-da1e907313e6_sou6_hq8
Nov 05 12:13:32 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62" returned: 0 in 0.541s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack sudo[107766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62
Nov 05 12:13:32 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c82b74cf-e420-4e86-9bf6-da1e907313e6_sou6_hq8" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82b74cf-e420-4e86-9bf6-da1e907313e6_sou6_hq8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58
Nov 05 12:13:32 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cb870818-27a4-49f0-a351-2a5ab6036f62" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82b74cf-e420-4e86-9bf6-da1e907313e6_sou6_hq8
Nov 05 12:13:32 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-cb870818-27a4-49f0-a351-2a5ab6036f62" released by "delete_volume" :: held 0.934s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Created reservations ['93719cd8-e54d-4a83-8dea-682bc67c4e73', '8f58c09f-ce63-4209-a514-e53fda5b9488', '7c591d60-474f-41cb-8e7b-60e3fba3f9b1', '74e0add5-a2d5-446a-a939-0f615db1352f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:32 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-83b52308-3706-4eb8-a15c-b4e45f91dd58" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-83b52308-3706-4eb8-a15c-b4e45f91dd58" released by "delete_volume" :: held 0.839s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:32 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82b74cf-e420-4e86-9bf6-da1e907313e6_sou6_hq8" returned: 1 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82b74cf-e420-4e86-9bf6-da1e907313e6_sou6_hq8' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b2aa4b-7d19-4014-b8b8-d5e1bf7e2bf6]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:32 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created reservations ['241f020a-8029-43b8-b3e1-18747fb0f227', '5fca8f59-00c2-48ec-a70a-09675a7fe0ce', '5b14bf7f-6260-4b75-a2b9-56603c98ba9a', '710aeda0-ea42-41a8-a74b-846562cb9700'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:33 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD
Nov 05 12:13:33 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:33 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:33 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-f261672f-b769-4b30-a52f-02f951ae28cd-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-f261672f-b769-4b30-a52f-02f951ae28cd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.361s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Deleted volume successfully.
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8282cd16-1aa3-4fb9-a78d-c48eb3c0c0ca tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-cb870818-27a4-49f0-a351-2a5ab6036f62-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-quobyte-f261672f-b769-4b30-a52f-02f951ae28cd" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-f261672f-b769-4b30-a52f-02f951ae28cd" acquired by "delete_volume" :: waited 0.056s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b58e371-1122-4691-b5b8-f56b1dfa83bb]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:33 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:33 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Deleted volume successfully.
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-67d319ce-d328-44b4-a6e5-8916be71591d tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-83b52308-3706-4eb8-a15c-b4e45f91dd58-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:33 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd
Nov 05 12:13:33 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:33 devstack sudo[107793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD
Nov 05 12:13:33 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:33 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:33 devstack sudo[107801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd
Nov 05 12:13:33 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:33 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD" returned: 1 in 0.411s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] c82b74cf-e420-4e86-9bf6-da1e907313e6 was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-c812bc68-514b-49b0-a496-02621b21fe69-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack sudo[107804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe
Nov 05 12:13:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-c812bc68-514b-49b0-a496-02621b21fe69-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "cinder-quobyte-c812bc68-514b-49b0-a496-02621b21fe69" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-c812bc68-514b-49b0-a496-02621b21fe69" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c67fe6-eb44-4c6f-99b4-c9a349aaad53]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f261672f-b769-4b30-a52f-02f951ae28cd" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-f261672f-b769-4b30-a52f-02f951ae28cd" released by "delete_volume" :: held 0.807s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created reservations ['2c00ce48-3882-451d-ab5b-7672bfb7456b', 'd1a0962d-f860-4a73-a8cb-91f1f23d1e82', 'c60742dc-8d32-4409-a675-3f94a4550ec7', 'ab72d6bb-81f7-4cd8-9d73-30d7b39d4dd7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:34 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69
Nov 05 12:13:34 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:34 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-c7afde85-c494-4a2f-90a8-fac1e9aecad7-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-c7afde85-c494-4a2f-90a8-fac1e9aecad7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:34 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-quobyte-c7afde85-c494-4a2f-90a8-fac1e9aecad7" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe" returned: 0 in 0.671s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c82b74cf-e420-4e86-9bf6-da1e907313e6_yvktgrr1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:13:34 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-c7afde85-c494-4a2f-90a8-fac1e9aecad7" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:34 devstack sudo[107818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe 1G
Nov 05 12:13:34 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9256ddc9-ed4c-469c-ab54-2484db3a29bf]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69" returned: 0 in 0.596s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69
Nov 05 12:13:34 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Deleted volume successfully.
Nov 05 12:13:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-242ffc7c-2413-4b82-8331-507afe548614 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-f261672f-b769-4b30-a52f-02f951ae28cd-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:34 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7
Nov 05 12:13:34 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:35 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c812bc68-514b-49b0-a496-02621b21fe69" returned: 0 in 0.300s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-quobyte-c812bc68-514b-49b0-a496-02621b21fe69" released by "delete_volume" :: held 0.974s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:35 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe 1G" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Downloaded image c82b74cf-e420-4e86-9bf6-da1e907313e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c82b74cf-e420-4e86-9bf6-da1e907313e6', 'metadata': {}}])) to volume 06738577-e6b0-43c6-903e-937cc0d967fe successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Temporary image c82b74cf-e420-4e86-9bf6-da1e907313e6 for user 9fd85562b521437fb606e0f6205305cc is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Marking volume 06738577-e6b0-43c6-903e-937cc0d967fe as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Copying metadata from image c82b74cf-e420-4e86-9bf6-da1e907313e6 to 06738577-e6b0-43c6-903e-937cc0d967fe. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Creating volume glance metadata for volume 06738577-e6b0-43c6-903e-937cc0d967fe backed by image c82b74cf-e420-4e86-9bf6-da1e907313e6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c82b74cf-e420-4e86-9bf6-da1e907313e6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c441c9d90e0bd6f4b87e43e148b4a9f8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Created reservations ['e1e6f337-53ec-4c26-b2b8-77fba06506e7', '8d4fc0a4-3265-4237-9250-aa3b9150c8be', 'd6068b16-b03f-483a-ac93-98826f881bd8', '2bd92737-9d8d-4107-9d7a-3dee1b78a02c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:35 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7" returned: 0 in 0.504s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:35 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7
Nov 05 12:13:35 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069b7b1f-7ad0-4ea4-a5da-a12add6bc3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06738577-e6b0-43c6-903e-937cc0d967fe', 'volume_size': 1, 'image_id': 'c82b74cf-e420-4e86-9bf6-da1e907313e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c82b74cf-e420-4e86-9bf6-da1e907313e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c441c9d90e0bd6f4b87e43e148b4a9f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e9d984707b54ae3bf9f6060332a0bd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f1cf06d298b72c99d64948b3b7534d2c06195482fdfe11cad108ed0ece38744f0bb6d32a4816ae0328ea21339a50a1b9fdb77e413c23ab72eef9b6b29608e79', 'id': 'c82b74cf-e420-4e86-9bf6-da1e907313e6', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c82b74cf-e420-4e86-9bf6-da1e907313e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710449ea5e20>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4372d5-1ad1-4364-913f-9023c305fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Volume volume-06738577-e6b0-43c6-903e-937cc0d967fe (06738577-e6b0-43c6-903e-937cc0d967fe): created successfully
Nov 05 12:13:35 devstack sudo[107838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:35 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4372d5-1ad1-4364-913f-9023c305fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Flow 'volume_create_manager' (7b130b19-b385-4815-9fc5-038951d879d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dd835c29-74a9-4eb7-880e-73ed9d12d1b7 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Created volume successfully.
Nov 05 12:13:35 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c7afde85-c494-4a2f-90a8-fac1e9aecad7" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-c7afde85-c494-4a2f-90a8-fac1e9aecad7" released by "delete_volume" :: held 0.852s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:35 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Deleted volume successfully.
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created reservations ['d585a970-5c37-4950-807e-f15e6d9c71c7', '3519f9a5-f8ff-42b0-8b29-d08c34b1701e', 'e4aac58a-625e-4513-911b-fa466a2a1c63', 'db7dc3d3-dc27-427b-a981-5f27b7ef053d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f1f50ac4-ac5a-4d82-bdc8-37f94d2b9bea tempest-CreateVolumesFromImageTest-1917121074 None] Lock "cinder-c812bc68-514b-49b0-a496-02621b21fe69-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:35 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:35 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:35 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Deleted volume successfully.
Nov 05 12:13:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7c9bf302-fea2-4419-9640-3a46874197c2 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-c7afde85-c494-4a2f-90a8-fac1e9aecad7-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Flow 'volume_create_manager' (e6612da2-7dda-4932-88da-4f63efffe833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71187204-b3cb-4367-bc1a-716211e91eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Acquiring lock "cinder-06738577-e6b0-43c6-903e-937cc0d967fe-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71187204-b3cb-4367-bc1a-716211e91eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252473614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c7b252-2263-4828-bf37-111abffe19c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68857227b1e4a6380a776cd8ad7fa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:36Z,use_quota=True,user_id='dae988a0eebf4e15a4806360f592f686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8735ddd0-60f7-4ef0-bcaf-8d0711a69fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8735ddd0-60f7-4ef0-bcaf-8d0711a69fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d80acb4-4e7d-4f8a-884f-74ddbc66e5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d80acb4-4e7d-4f8a-884f-74ddbc66e5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c7b252-2263-4828-bf37-111abffe19c9', 'volume_name': 'volume-50c7b252-2263-4828-bf37-111abffe19c9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a3235e-959d-4f2e-bb17-6f41ff27483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a3235e-959d-4f2e-bb17-6f41ff27483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f9b86e-b125-4438-828c-9f6987c4a46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Volume 50c7b252-2263-4828-bf37-111abffe19c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c7b252-2263-4828-bf37-111abffe19c9', 'volume_size': 1}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252473614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c7b252-2263-4828-bf37-111abffe19c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68857227b1e4a6380a776cd8ad7fa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:36Z,use_quota=True,user_id='dae988a0eebf4e15a4806360f592f686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Creating volume 50c7b252-2263-4828-bf37-111abffe19c9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "cinder-06738577-e6b0-43c6-903e-937cc0d967fe-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:36 devstack sudo[107845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9 1073741824
Nov 05 12:13:36 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Acquiring lock "cinder-quobyte-06738577-e6b0-43c6-903e-937cc0d967fe" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "cinder-quobyte-06738577-e6b0-43c6-903e-937cc0d967fe" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e2dfd-809a-4d81-8596-11446086cb6e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:36 devstack sudo[107848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe
Nov 05 12:13:36 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-f4aab4a8-80a9-484b-9b3b-32d7e454934e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-f4aab4a8-80a9-484b-9b3b-32d7e454934e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-quobyte-f4aab4a8-80a9-484b-9b3b-32d7e454934e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-f4aab4a8-80a9-484b-9b3b-32d7e454934e" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[427aaa7c-c6d8-4897-8ea5-2652a7b26bbb]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe" returned: 0 in 0.589s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e
Nov 05 12:13:37 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9 1073741824" returned: 0 in 0.729s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack sudo[107859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe
Nov 05 12:13:37 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9
Nov 05 12:13:37 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-06738577-e6b0-43c6-903e-937cc0d967fe" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "cinder-quobyte-06738577-e6b0-43c6-903e-937cc0d967fe" released by "delete_volume" :: held 0.952s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:37 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e" returned: 0 in 0.561s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Created reservations ['97debc00-e0a5-48e5-9683-9f4d248ba3b9', 'dc14068d-d1f3-4fda-b901-753fb0615707', '51aaf243-f63b-4a29-a179-7b02163d36b6', '9e4b88e4-0c25-40c5-bd01-8cac77c2d3d9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:37 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:37 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e
Nov 05 12:13:37 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f9b86e-b125-4438-828c-9f6987c4a46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c7b252-2263-4828-bf37-111abffe19c9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96b7dfd-bf67-43ac-bd40-04824c5444d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Volume volume-50c7b252-2263-4828-bf37-111abffe19c9 (50c7b252-2263-4828-bf37-111abffe19c9): created successfully
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96b7dfd-bf67-43ac-bd40-04824c5444d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Flow 'volume_create_manager' (e6612da2-7dda-4932-88da-4f63efffe833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-555c5e33-9651-4799-add0-c24895c94650 tempest-ProjectReaderTests-951632115 None] Created volume successfully.
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:37 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f4aab4a8-80a9-484b-9b3b-32d7e454934e" returned: 0 in 0.312s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-f4aab4a8-80a9-484b-9b3b-32d7e454934e" released by "delete_volume" :: held 0.938s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created reservations ['d9d87e00-35d1-4994-9ec1-5ddde5efc912', '3f95b2fd-69f3-4b12-aa09-1cf70c208f60', 'b95ede26-4797-4dc8-8b04-99a4bf1caedc', 'e43a1ec7-ec65-49b8-ba97-418d3c3fac78'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:38 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Deleted volume successfully.
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-49976718-4a7c-449c-a0bd-dd0c2f772d94 tempest-VolumeAndVolumeTypeFromImageTest-948690377 None] Lock "cinder-06738577-e6b0-43c6-903e-937cc0d967fe-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:38 devstack sudo[107874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:38 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:38 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.242s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Deleted volume successfully.
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3bd93907-3978-4394-a6ef-869c24b820d4 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-f4aab4a8-80a9-484b-9b3b-32d7e454934e-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Acquiring lock "cinder-50c7b252-2263-4828-bf37-111abffe19c9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Lock "cinder-50c7b252-2263-4828-bf37-111abffe19c9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Acquiring lock "cinder-quobyte-50c7b252-2263-4828-bf37-111abffe19c9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Lock "cinder-quobyte-50c7b252-2263-4828-bf37-111abffe19c9" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ac80d-cc86-435c-9c55-f90de10e89bb]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:39 devstack sudo[107877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9
Nov 05 12:13:39 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-7cac8378-d191-438e-9455-407641115f95-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-7cac8378-d191-438e-9455-407641115f95-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-quobyte-7cac8378-d191-438e-9455-407641115f95" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-7cac8378-d191-438e-9455-407641115f95" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e75394-8b6e-400e-9a79-ea5269da303c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:39 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9" returned: 0 in 0.460s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:39 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9
Nov 05 12:13:39 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:39 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95
Nov 05 12:13:39 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:39 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-50c7b252-2263-4828-bf37-111abffe19c9" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Lock "cinder-quobyte-50c7b252-2263-4828-bf37-111abffe19c9" released by "delete_volume" :: held 0.869s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:39 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (d68e2181-35be-4be8-9d2c-4977a5c3ebb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a8b98d-94a3-485c-951c-ad241101028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:39 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95
Nov 05 12:13:39 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a8b98d-94a3-485c-951c-ad241101028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772090622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8253707-9d01-40ce-a509-fda249670634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:40Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4fd2ea-45ed-4922-83d7-1f18ebb19531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4fd2ea-45ed-4922-83d7-1f18ebb19531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e598af2a-c797-496c-a4b7-a56ac649a381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e598af2a-c797-496c-a4b7-a56ac649a381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8253707-9d01-40ce-a509-fda249670634', 'volume_name': 'volume-e8253707-9d01-40ce-a509-fda249670634', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2d260d-b6cb-4d3d-8a34-09aeb52ef9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2d260d-b6cb-4d3d-8a34-09aeb52ef9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e01194-7afe-4085-91dc-f3792ccbff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume e8253707-9d01-40ce-a509-fda249670634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8253707-9d01-40ce-a509-fda249670634', 'volume_size': 1}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772090622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8253707-9d01-40ce-a509-fda249670634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:40Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Creating volume e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Created reservations ['5cc09b77-1905-47f2-8e3d-2ce8c25ca98b', 'e43f8596-f102-4363-98eb-9484ef0b40ef', '7011882f-22e7-47db-b9d2-5ef8a52e07f0', 'a65e8377-a3ad-4f9a-9924-a67c08c2183f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:39 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 1073741824
Nov 05 12:13:39 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:40 devstack sudo[107895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:40 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:40 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7cac8378-d191-438e-9455-407641115f95" returned: 0 in 0.297s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-7cac8378-d191-438e-9455-407641115f95" released by "delete_volume" :: held 0.863s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created reservations ['741c2678-9687-4dc1-9bf4-1cf3d7a53404', '4e12ed74-c9e6-4c68-8516-047544cdf92f', 'f0baa382-8f64-4b7a-bc1f-abc33fb6c315', '4accee50-9821-40bd-84d2-41ef11f2b3b1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:40 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.345s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:40 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:40 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Deleted volume successfully.
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da324c79-d769-4b54-a816-d91282a3510c tempest-ProjectReaderTests-951632115 None] Lock "cinder-50c7b252-2263-4828-bf37-111abffe19c9-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "cinder-quobyte-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:40 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 1073741824" returned: 0 in 0.621s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b96983-04df-4023-99ef-2d1caea829c8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:40 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634
Nov 05 12:13:40 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:40 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b
Nov 05 12:13:40 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:40 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Deleted volume successfully.
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3398455a-abb1-4288-b5db-63fdd280a681 tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-7cac8378-d191-438e-9455-407641115f95-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:40 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e01194-7afe-4085-91dc-f3792ccbff8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8253707-9d01-40ce-a509-fda249670634', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffc9f3e-2349-46a7-835d-0f7e5d81d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume volume-e8253707-9d01-40ce-a509-fda249670634 (e8253707-9d01-40ce-a509-fda249670634): created successfully
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffc9f3e-2349-46a7-835d-0f7e5d81d51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (d68e2181-35be-4be8-9d2c-4977a5c3ebb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1fb197cb-0f91-4308-b682-c20940e8cefe tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created volume successfully.
Nov 05 12:13:41 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b" returned: 0 in 0.488s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:41 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b
Nov 05 12:13:41 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:41 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-quobyte-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b" released by "delete_volume" :: held 0.858s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Created reservations ['3c2b066d-2b60-44fa-979d-6a45e48fe9db', '14e09165-b22a-4a04-a77c-0c7a4d97b9c7', '2f79eb80-17eb-44b0-8379-150b818c2dc4', '05e0bd29-d872-4398-9156-c6f399c14fa1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:41 devstack sudo[107918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:41 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Flow 'volume_create_manager' (d06051fc-6e34-4f17-b06b-3050c650f010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5967f4f-1b6d-4ebd-98d7-62ca143e6447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5967f4f-1b6d-4ebd-98d7-62ca143e6447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1595568246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e433a0b7-724f-4387-a79d-bcd6e0e8fc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68857227b1e4a6380a776cd8ad7fa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:42Z,use_quota=True,user_id='dae988a0eebf4e15a4806360f592f686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b2003e-848b-4a58-9fb4-6c26c317f1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b2003e-848b-4a58-9fb4-6c26c317f1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5dce14-fcbb-47dc-ab0a-d27dcb9e6df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5dce14-fcbb-47dc-ab0a-d27dcb9e6df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e433a0b7-724f-4387-a79d-bcd6e0e8fc16', 'volume_name': 'volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf2793-b485-4f17-8b40-cf818270e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf2793-b485-4f17-8b40-cf818270e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce0bded-23e6-4d0b-afa1-4d08a2b819ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Volume e433a0b7-724f-4387-a79d-bcd6e0e8fc16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16', 'volume_size': 1}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1595568246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e433a0b7-724f-4387-a79d-bcd6e0e8fc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68857227b1e4a6380a776cd8ad7fa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:42Z,use_quota=True,user_id='dae988a0eebf4e15a4806360f592f686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Creating volume e433a0b7-724f-4387-a79d-bcd6e0e8fc16 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:41 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16 1073741824
Nov 05 12:13:41 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:42 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Deleted volume successfully.
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5c17a70-d2d5-460f-b671-a4c40a051ffa tempest-CreateVolumesFromSourceVolumeTest-1752694123 None] Lock "cinder-76ee4d00-5a64-4c6a-aa5e-da49bcbe6d2b-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:42 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16 1073741824" returned: 0 in 0.707s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:42 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16
Nov 05 12:13:42 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:42 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.590s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce0bded-23e6-4d0b-afa1-4d08a2b819ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fffe92d-5cb1-4c4e-89b8-41160e1260eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Creating offline snapshot 360ca274-5e15-4863-b4c0-1ce976586b79 of volume e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:13:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Volume volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16 (e433a0b7-724f-4387-a79d-bcd6e0e8fc16): created successfully
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fffe92d-5cb1-4c4e-89b8-41160e1260eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Flow 'volume_create_manager' (d06051fc-6e34-4f17-b06b-3050c650f010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0c8b62-ecf5-4303-9687-2b0c402e7ad9]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5a835694-85bb-428b-b7c4-1382431460e4 tempest-ProjectReaderTests-951632115 None] Created volume successfully.
Nov 05 12:13:43 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634
Nov 05 12:13:43 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:43 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:43 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 1G
Nov 05 12:13:43 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Acquiring lock "cinder-e433a0b7-724f-4387-a79d-bcd6e0e8fc16-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Lock "cinder-e433a0b7-724f-4387-a79d-bcd6e0e8fc16-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Acquiring lock "cinder-quobyte-e433a0b7-724f-4387-a79d-bcd6e0e8fc16" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Lock "cinder-quobyte-e433a0b7-724f-4387-a79d-bcd6e0e8fc16" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf224a4-8090-42d0-b68d-85f8635e2628]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:44 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 1G" returned: 0 in 0.611s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8253707-9d01-40ce-a509-fda249670634 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:44 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16
Nov 05 12:13:44 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:44 devstack sudo[107949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8253707-9d01-40ce-a509-fda249670634 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79
Nov 05 12:13:44 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:44 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16" returned: 0 in 0.479s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:44 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16
Nov 05 12:13:44 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:44 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8253707-9d01-40ce-a509-fda249670634 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:44 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 is being set with open permissions: ugo+rw
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:44 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79
Nov 05 12:13:44 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:44 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e433a0b7-724f-4387-a79d-bcd6e0e8fc16" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Lock "cinder-quobyte-e433a0b7-724f-4387-a79d-bcd6e0e8fc16" released by "delete_volume" :: held 0.879s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Created reservations ['afcc1103-85d8-486f-8c64-43777c157eab', '3fbc1f44-e1df-4865-86e7-6dcbe2e13763', 'f5b398e1-64fa-4a3b-af33-eb305994c69c', '281ea503-c241-43f5-afa7-cd13e42b5272'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:44 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:44 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.info
Nov 05 12:13:44 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:44 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:44 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:45 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.info" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:45 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.info is being set with open permissions: ugo+rw
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:45 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:45 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.info
Nov 05 12:13:45 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Deleted volume successfully.
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bddfa87a-d221-4b3d-8755-d88f236920c2 tempest-ProjectReaderTests-951632115 None] Lock "cinder-e433a0b7-724f-4387-a79d-bcd6e0e8fc16-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:45 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:45 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:45 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.info" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a5343e03-4eca-434a-96c6-a86a15481b74 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Create snapshot completed successfully
Nov 05 12:13:45 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:13:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Flow 'volume_create_manager' (ceafe6b2-192f-49b3-b69b-08176c04b1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0d9c7b-0440-4aea-a31c-e66a197e2444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0d9c7b-0440-4aea-a31c-e66a197e2444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2123097328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a2862f-d9bd-4299-a67c-c77012a3d527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770af88292f9401aa17d57b7dc4e8c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:46Z,use_quota=True,user_id='69b3a10f04024fd9ae0ddcfa3ea553c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5486ba-9f10-45b1-bc7b-ce4d25fd4511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5486ba-9f10-45b1-bc7b-ce4d25fd4511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16013b6d-d78e-469b-992a-8dde5c8b3555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16013b6d-d78e-469b-992a-8dde5c8b3555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a2862f-d9bd-4299-a67c-c77012a3d527', 'volume_name': 'volume-55a2862f-d9bd-4299-a67c-c77012a3d527', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315c12c1-92a2-457b-8850-8b7ac4b2036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315c12c1-92a2-457b-8850-8b7ac4b2036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2d9cd7-8adf-4915-9a57-491265a32414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:46 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Volume 55a2862f-d9bd-4299-a67c-c77012a3d527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a2862f-d9bd-4299-a67c-c77012a3d527', 'volume_size': 1}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2123097328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a2862f-d9bd-4299-a67c-c77012a3d527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770af88292f9401aa17d57b7dc4e8c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:46Z,use_quota=True,user_id='69b3a10f04024fd9ae0ddcfa3ea553c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Creating volume 55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:46 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:46 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 1073741824
Nov 05 12:13:46 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:46 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 1073741824" returned: 0 in 0.674s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:47 devstack sudo[107982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527
Nov 05 12:13:47 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (e7dc1aed-8650-4f58-8657-2f1e0d4b473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e7d975-b2aa-47c7-b3b2-abd6573a44be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e7d975-b2aa-47c7-b3b2-abd6573a44be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1661067968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:47Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378e478c-5cfd-4547-ab0c-98013f73581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378e478c-5cfd-4547-ab0c-98013f73581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa0822e-d486-4228-948a-25acddcaeb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa0822e-d486-4228-948a-25acddcaeb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec', 'volume_name': 'volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a661ddd-44c2-44c7-a22c-cb276a091bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a661ddd-44c2-44c7-a22c-cb276a091bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e576e850-a76e-49bd-bbea-c23651b1437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume 113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec', 'volume_size': 1}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:47 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1661067968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:47Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Creating volume 113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:47 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2d9cd7-8adf-4915-9a57-491265a32414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a2862f-d9bd-4299-a67c-c77012a3d527', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec 1073741824
Nov 05 12:13:47 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b8d9d-aa71-4800-97a1-a7b686bea9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Volume volume-55a2862f-d9bd-4299-a67c-c77012a3d527 (55a2862f-d9bd-4299-a67c-c77012a3d527): created successfully
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b8d9d-aa71-4800-97a1-a7b686bea9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Flow 'volume_create_manager' (ceafe6b2-192f-49b3-b69b-08176c04b1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d4c4c8f6-3daa-4239-9ac7-1d4d7a5e45bc tempest-VolumeDependencyTests-1182641893 None] Created volume successfully.
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (6529f896-0ae5-4cea-849c-1a1962a4f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99dd720-4125-4481-99aa-1dd2d6d2856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99dd720-4125-4481-99aa-1dd2d6d2856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219710323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881ce8d-6e47-48cf-a491-278ec8dd992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:48Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1d508b-7e2f-4ed0-b89a-eef9cffb85e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1d508b-7e2f-4ed0-b89a-eef9cffb85e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d26f9cf-154c-47cf-9d85-061dcec45b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d26f9cf-154c-47cf-9d85-061dcec45b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3881ce8d-6e47-48cf-a491-278ec8dd992b', 'volume_name': 'volume-3881ce8d-6e47-48cf-a491-278ec8dd992b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20087131-8707-41a0-8d08-4c87187f2813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20087131-8707-41a0-8d08-4c87187f2813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ebfa6-d7da-4d03-8507-dcfce89b4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume 3881ce8d-6e47-48cf-a491-278ec8dd992b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3881ce8d-6e47-48cf-a491-278ec8dd992b', 'volume_size': 1}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:48 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec 1073741824" returned: 0 in 0.813s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:48 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec
Nov 05 12:13:48 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Flow 'volume_create_manager' (06908838-4b16-41c7-ac95-f2e781cf74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6374095d-53ef-4784-813b-d703ceb6dd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6374095d-53ef-4784-813b-d703ceb6dd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bee0616-c4b5-4518-9cfc-7d963cd2a0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e1fafebe084375bbe422c22daf9228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:48Z,use_quota=True,user_id='444bfdb74ecf4133a981e34e736b5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3c1b81-5453-4682-9366-4d75303a9754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3c1b81-5453-4682-9366-4d75303a9754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fc7184-d7ee-421e-97b2-dfb6eac4ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219710323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881ce8d-6e47-48cf-a491-278ec8dd992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:48Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Creating volume 3881ce8d-6e47-48cf-a491-278ec8dd992b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:48 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:48 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b 1073741824
Nov 05 12:13:48 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (d10f7c25-2b47-4d98-87f2-475a8abe8814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bace4a34-3f54-405d-a581-a51d7ffe4e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e576e850-a76e-49bd-bbea-c23651b1437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156faa7c-d83b-4cba-a0d9-d5d0573df710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bace4a34-3f54-405d-a581-a51d7ffe4e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1253275177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e019a0-c5ec-41b9-939c-f4af230de753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:48Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6ce484-1ca6-4f5d-b79a-c121c0c11a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6ce484-1ca6-4f5d-b79a-c121c0c11a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa2923d-3986-4dc3-b952-3bb3ae5a1707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa2923d-3986-4dc3-b952-3bb3ae5a1707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e019a0-c5ec-41b9-939c-f4af230de753', 'volume_name': 'volume-d8e019a0-c5ec-41b9-939c-f4af230de753', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf9ddc3-9d3c-42e5-bc1e-fbec3d7f3432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf9ddc3-9d3c-42e5-bc1e-fbec3d7f3432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c28a9a2-6724-45a4-a05f-2ca81378b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume d8e019a0-c5ec-41b9-939c-f4af230de753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e019a0-c5ec-41b9-939c-f4af230de753', 'volume_size': 1}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec (113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec): created successfully
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156faa7c-d83b-4cba-a0d9-d5d0573df710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (e7dc1aed-8650-4f58-8657-2f1e0d4b473f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (441ccd90-f168-4495-a28b-63fa87c54c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ffbbf5-36a0-4599-865b-fe0377c649da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c3938bbb-b101-4029-9e97-35d03d807aa4 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created volume successfully.
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ffbbf5-36a0-4599-865b-fe0377c649da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964106971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e645097-876a-4b38-857d-92a98624e32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:49Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26866858-627d-4982-8a34-e0b8808deb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26866858-627d-4982-8a34-e0b8808deb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da6b8eb-0d42-4831-9da7-05763d7856ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da6b8eb-0d42-4831-9da7-05763d7856ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e645097-876a-4b38-857d-92a98624e32e', 'volume_name': 'volume-9e645097-876a-4b38-857d-92a98624e32e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683116b7-f1f3-4cff-b93e-73e9829f7040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683116b7-f1f3-4cff-b93e-73e9829f7040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf05ac0-8053-4407-8540-7cba8899c8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume 9e645097-876a-4b38-857d-92a98624e32e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e645097-876a-4b38-857d-92a98624e32e', 'volume_size': 1}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:49 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b 1073741824" returned: 0 in 0.677s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:49 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b
Nov 05 12:13:49 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fc7184-d7ee-421e-97b2-dfb6eac4ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bee0616-c4b5-4518-9cfc-7d963cd2a0fe', 'volume_name': 'volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe', 'volume_size': 1, 'image_id': 'd100a8f2-2143-4340-83ae-628b6d3af916', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d100a8f2-2143-4340-83ae-628b6d3af916', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c9f3099381aaa456cd4576e5fd6f14a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2e1fafebe084375bbe422c22daf9228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '667dd9ebf8c66938898476c002ed484223b43b2fb393bd46b4a4d76ae549b72d2953a3ac8fc22e3dc472ef95eae55636bcaf3a0b7c37004cfecec07be9924fe3', 'id': 'd100a8f2-2143-4340-83ae-628b6d3af916', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d100a8f2-2143-4340-83ae-628b6d3af916/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710453f866c0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c495f-e878-43cd-876e-9d7bdb500e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c495f-e878-43cd-876e-9d7bdb500e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6244c8-ade3-46f6-a5e9-bce398778d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Volume 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe', 'volume_size': 1, 'image_id': 'd100a8f2-2143-4340-83ae-628b6d3af916', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d100a8f2-2143-4340-83ae-628b6d3af916', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c9f3099381aaa456cd4576e5fd6f14a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2e1fafebe084375bbe422c22daf9228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '667dd9ebf8c66938898476c002ed484223b43b2fb393bd46b4a4d76ae549b72d2953a3ac8fc22e3dc472ef95eae55636bcaf3a0b7c37004cfecec07be9924fe3', 'id': 'd100a8f2-2143-4340-83ae-628b6d3af916', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d100a8f2-2143-4340-83ae-628b6d3af916/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710453f866c0>}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Trying to clone 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe from image d100a8f2-2143-4340-83ae-628b6d3af916 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d100a8f2-2143-4340-83ae-628b6d3af916', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (31698d40-3fbd-4fb5-9f04-f0c840819e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b0f2a-320d-4fe8-b11f-ecd0f4da0d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b0f2a-320d-4fe8-b11f-ecd0f4da0d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820195636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:50Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2301c0e1-9f48-4cd4-8997-4e5decb2a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2301c0e1-9f48-4cd4-8997-4e5decb2a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb74f03-e45f-41bd-9dff-9dae870cc090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb74f03-e45f-41bd-9dff-9dae870cc090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00bb0ad-eb14-4747-99e3-f8a2dc29fd6e', 'volume_name': 'volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e91b1b-1bdd-445b-93c9-9218b4649950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e91b1b-1bdd-445b-93c9-9218b4649950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11967839-827c-4d3b-8063-24ee77e72030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e', 'volume_size': 1}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b" returned: 0 in 0.427s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1253275177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e019a0-c5ec-41b9-939c-f4af230de753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:48Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Creating volume d8e019a0-c5ec-41b9-939c-f4af230de753 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a7171-c4a5-4e55-8529-b67e7f3ff504]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:49 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753 1073741824
Nov 05 12:13:49 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ebfa6-d7da-4d03-8507-dcfce89b4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3881ce8d-6e47-48cf-a491-278ec8dd992b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6c3417-db6b-495e-8755-e0a319e60680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume volume-3881ce8d-6e47-48cf-a491-278ec8dd992b (3881ce8d-6e47-48cf-a491-278ec8dd992b): created successfully
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6c3417-db6b-495e-8755-e0a319e60680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (6529f896-0ae5-4cea-849c-1a1962a4f154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0bcdce32-b093-4e75-bd6d-0f6e964c611d tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created volume successfully.
Nov 05 12:13:50 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD
Nov 05 12:13:50 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:50 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD
Nov 05 12:13:50 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753 1073741824" returned: 0 in 0.558s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:50 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753
Nov 05 12:13:50 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Temporary image d100a8f2-2143-4340-83ae-628b6d3af916 is fetched for user 444bfdb74ecf4133a981e34e736b5e26. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9155b31-b54a-4cb8-bf7d-abcfa1a53095]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:50 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964106971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e645097-876a-4b38-857d-92a98624e32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:49Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Creating volume 9e645097-876a-4b38-857d-92a98624e32e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:50 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c28a9a2-6724-45a4-a05f-2ca81378b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e019a0-c5ec-41b9-939c-f4af230de753', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:50 devstack sudo[108024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e 1073741824
Nov 05 12:13:50 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41820368-ed69-42f1-bb0e-f7a3cab2d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume volume-d8e019a0-c5ec-41b9-939c-f4af230de753 (d8e019a0-c5ec-41b9-939c-f4af230de753): created successfully
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41820368-ed69-42f1-bb0e-f7a3cab2d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (d10f7c25-2b47-4d98-87f2-475a8abe8814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:50 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD
Nov 05 12:13:50 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6761d990-98c2-4674-9625-b10b958fa984 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created volume successfully.
Nov 05 12:13:51 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:51 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD
Nov 05 12:13:51 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:51 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e 1073741824" returned: 0 in 0.576s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:51 devstack sudo[108035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e
Nov 05 12:13:51 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:51 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:51 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e" returned: 0 in 0.297s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf05ac0-8053-4407-8540-7cba8899c8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e645097-876a-4b38-857d-92a98624e32e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7308fd-5a43-4e15-b337-c4a82e6e6bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Creating offline snapshot 9994710a-a713-41f1-949e-c90602e4a64f of volume 55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:13:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume volume-9e645097-876a-4b38-857d-92a98624e32e (9e645097-876a-4b38-857d-92a98624e32e): created successfully
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7308fd-5a43-4e15-b337-c4a82e6e6bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (441ccd90-f168-4495-a28b-63fa87c54c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab4c00-d1fb-490a-b225-1e6db64b4b31]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cc1d1271-30b5-42ab-9258-c93247f1b385 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created volume successfully.
Nov 05 12:13:51 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527
Nov 05 12:13:51 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:52 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527" returned: 0 in 0.437s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:52 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f 1G
Nov 05 12:13:52 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:52 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f 1G" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a2862f-d9bd-4299-a67c-c77012a3d527 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:52 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a2862f-d9bd-4299-a67c-c77012a3d527 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f
Nov 05 12:13:52 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:53 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a2862f-d9bd-4299-a67c-c77012a3d527 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:53 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f is being set with open permissions: ugo+rw
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:53 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f
Nov 05 12:13:53 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:53 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:53 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.info
Nov 05 12:13:53 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:53 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.info" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:53 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.info is being set with open permissions: ugo+rw
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:53 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.info
Nov 05 12:13:53 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:53 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.info" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.980s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820195636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ffc0d7035451ba69100cfad4f8508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:50Z,use_quota=True,user_id='a5810aee26aa4c6e9e44005fb6e2fc6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Creating volume d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:53 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:53 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e 1073741824
Nov 05 12:13:53 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b0f148e6-4e28-43bf-9449-c6125c74ab91 tempest-VolumeDependencyTests-1182641893 None] Create snapshot completed successfully
Nov 05 12:13:54 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e 1073741824" returned: 0 in 0.492s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:54 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e
Nov 05 12:13:54 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:54 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.153s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bee0616-c4b5-4518-9cfc-7d963cd2a0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e1fafebe084375bbe422c22daf9228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:48Z,use_quota=True,user_id='444bfdb74ecf4133a981e34e736b5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Creating volume 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11967839-827c-4d3b-8063-24ee77e72030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe 1073741824
Nov 05 12:13:54 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee0c366-228d-4ffb-83d9-e9a9cc2e4aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Volume volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e (d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e): created successfully
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee0c366-228d-4ffb-83d9-e9a9cc2e4aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Flow 'volume_create_manager' (31698d40-3fbd-4fb5-9f04-f0c840819e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-da777ffb-ea27-4032-a13c-cd2879050257 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created volume successfully.
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:55 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe 1073741824" returned: 0 in 0.569s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Flow 'volume_create_manager' (f335d8be-cbdb-4a85-9f34-fdc435f760c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8721f32d-5186-4489-bf2e-5a65c76f7ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8721f32d-5186-4489-bf2e-5a65c76f7ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1487599058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e822467a-db53-4cff-84b0-e5abba5ff169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770af88292f9401aa17d57b7dc4e8c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9994710a-a713-41f1-949e-c90602e4a64f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='69b3a10f04024fd9ae0ddcfa3ea553c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91172987-3f90-4cb8-aa47-25cbb14a48c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91172987-3f90-4cb8-aa47-25cbb14a48c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511e332d-b002-44f3-80ad-3cc785ac6904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511e332d-b002-44f3-80ad-3cc785ac6904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e822467a-db53-4cff-84b0-e5abba5ff169', 'volume_name': 'volume-e822467a-db53-4cff-84b0-e5abba5ff169', 'volume_size': 1, 'snapshot_id': '9994710a-a713-41f1-949e-c90602e4a64f'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5484fbca-645b-4b00-abe5-24097ba1b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5484fbca-645b-4b00-abe5-24097ba1b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb67fc9c-4fac-4e00-9828-e9e0ff75f57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Volume e822467a-db53-4cff-84b0-e5abba5ff169: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e822467a-db53-4cff-84b0-e5abba5ff169', 'volume_size': 1, 'snapshot_id': '9994710a-a713-41f1-949e-c90602e4a64f'}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:55 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe
Nov 05 12:13:55 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44208991-92fd-4b9c-b59e-26e8f062d287]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:55 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e
Nov 05 12:13:55 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:55 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.318s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-quobyte-9994710a-a713-41f1-949e-c90602e4a64f-e822467a-db53-4cff-84b0-e5abba5ff169" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-9994710a-a713-41f1-949e-c90602e4a64f-e822467a-db53-4cff-84b0-e5abba5ff169" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Creating volume e822467a-db53-4cff-84b0-e5abba5ff169 from snapshot 9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-quobyte-e822467a-db53-4cff-84b0-e5abba5ff169" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Attempting download of d100a8f2-2143-4340-83ae-628b6d3af916 ((None, [{'url': 'file:///opt/stack/data/glance/images/d100a8f2-2143-4340-83ae-628b6d3af916', 'metadata': {}}])) to volume 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-e822467a-db53-4cff-84b0-e5abba5ff169" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] snapshot: 9994710a-a713-41f1-949e-c90602e4a64f, volume: e822467a-db53-4cff-84b0-e5abba5ff169,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca43c2a-1c40-4248-bcd1-7cf703cadf05]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b025851-56d3-4145-bed4-59305c4ded3a]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d100a8f2-2143-4340-83ae-628b6d3af916_97hgw9fr {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:55 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f
Nov 05 12:13:56 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e
Nov 05 12:13:56 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d100a8f2-2143-4340-83ae-628b6d3af916_97hgw9fr
Nov 05 12:13:56 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55a2862f-d9bd-4299-a67c-c77012a3d527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:13:56 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[377eec00-fea3-4c64-9370-c6801545a585]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d100a8f2-2143-4340-83ae-628b6d3af916_97hgw9fr" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d100a8f2-2143-4340-83ae-628b6d3af916_97hgw9fr {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e" released by "delete_volume" :: held 0.895s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created reservations ['56191e15-6b99-41c2-8cf3-132bd06a398d', '8efcf976-e1ee-43f0-bd93-a5c77fc90591', 'ee321245-8481-45b5-bf09-fbc02d38ed57', '33425d06-cbb1-4e23-93cd-4cbcf7ac7c8a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:56 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527
Nov 05 12:13:56 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:56 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d100a8f2-2143-4340-83ae-628b6d3af916_97hgw9fr
Nov 05 12:13:56 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-9e645097-876a-4b38-857d-92a98624e32e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-9e645097-876a-4b38-857d-92a98624e32e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:56 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:56 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-9e645097-876a-4b38-857d-92a98624e32e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-9e645097-876a-4b38-857d-92a98624e32e" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ba60a1-fbea-4f7e-86eb-db6b31cad6cc]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527" returned: 0 in 0.495s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169
Nov 05 12:13:56 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e
Nov 05 12:13:56 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:57 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d100a8f2-2143-4340-83ae-628b6d3af916_97hgw9fr" returned: 1 in 0.713s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d100a8f2-2143-4340-83ae-628b6d3af916_97hgw9fr' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508e911-1a1b-447e-b45c-5209abc6b0f5]: (4, 'raw') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:57 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.628s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Deleted volume successfully.
Nov 05 12:13:57 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:57 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD
Nov 05 12:13:57 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:57 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dff726ac-0afc-469f-b289-3cacc0d41943 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-d00bb0ad-eb14-4747-99e3-f8a2dc29fd6e-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:57 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:57 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:57 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9e645097-876a-4b38-857d-92a98624e32e" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-9e645097-876a-4b38-857d-92a98624e32e" released by "delete_volume" :: held 0.896s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:57 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD
Nov 05 12:13:57 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:57 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created reservations ['a4b5c0e1-f2db-4607-95dd-d7373675e2ac', '0b17c8f0-25fb-4ac8-b9f3-f03db77073fc', '31617247-6be4-496a-8687-de0961b6fe84', 'f3696d9b-f200-42a2-8fae-3421b61add01'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:58 devstack sudo[108142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:13:58 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:58 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] d100a8f2-2143-4340-83ae-628b6d3af916 was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:58 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe
Nov 05 12:13:58 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:58 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.586s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Deleted volume successfully.
Nov 05 12:13:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52e22dc7-3ff2-4a33-b253-e7ecb1e6e73b tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-9e645097-876a-4b38-857d-92a98624e32e-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-d8e019a0-c5ec-41b9-939c-f4af230de753-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-d8e019a0-c5ec-41b9-939c-f4af230de753-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-d8e019a0-c5ec-41b9-939c-f4af230de753" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-d8e019a0-c5ec-41b9-939c-f4af230de753" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f616b-2c38-4b0f-b686-2f15917eccfa]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:59 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe" returned: 0 in 1.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d100a8f2-2143-4340-83ae-628b6d3af916_16lwgzbkdevstack@QuobyteHD, size 0.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:13:59 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:13:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:59 devstack sudo[108155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753
Nov 05 12:13:59 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:59 devstack sudo[108157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe 1G
Nov 05 12:13:59 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:00 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753" returned: 0 in 0.882s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:00 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753
Nov 05 12:14:00 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:00 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe 1G" returned: 0 in 0.934s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Downloaded image d100a8f2-2143-4340-83ae-628b6d3af916 ((None, [{'url': 'file:///opt/stack/data/glance/images/d100a8f2-2143-4340-83ae-628b6d3af916', 'metadata': {}}])) to volume 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Temporary image d100a8f2-2143-4340-83ae-628b6d3af916 for user 444bfdb74ecf4133a981e34e736b5e26 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Marking volume 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Copying metadata from image d100a8f2-2143-4340-83ae-628b6d3af916 to 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Creating volume glance metadata for volume 6bee0616-c4b5-4518-9cfc-7d963cd2a0fe backed by image d100a8f2-2143-4340-83ae-628b6d3af916 with: {'image_id': 'd100a8f2-2143-4340-83ae-628b6d3af916', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8c9f3099381aaa456cd4576e5fd6f14a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6244c8-ade3-46f6-a5e9-bce398778d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe', 'volume_size': 1, 'image_id': 'd100a8f2-2143-4340-83ae-628b6d3af916', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d100a8f2-2143-4340-83ae-628b6d3af916', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c9f3099381aaa456cd4576e5fd6f14a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2e1fafebe084375bbe422c22daf9228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '667dd9ebf8c66938898476c002ed484223b43b2fb393bd46b4a4d76ae549b72d2953a3ac8fc22e3dc472ef95eae55636bcaf3a0b7c37004cfecec07be9924fe3', 'id': 'd100a8f2-2143-4340-83ae-628b6d3af916', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d100a8f2-2143-4340-83ae-628b6d3af916/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x710453f866c0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15adeb2-fdcc-467b-9923-b5b2f3781e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Volume volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe (6bee0616-c4b5-4518-9cfc-7d963cd2a0fe): created successfully
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15adeb2-fdcc-467b-9923-b5b2f3781e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:00 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Flow 'volume_create_manager' (06908838-4b16-41c7-ac95-f2e781cf74fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d8e019a0-c5ec-41b9-939c-f4af230de753" returned: 0 in 0.594s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d27d5c17-40a5-47fc-9920-0fe104d2c79c tempest-VolumeImageDependencyTests-417344748 None] Created volume successfully.
Nov 05 12:14:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-d8e019a0-c5ec-41b9-939c-f4af230de753" released by "delete_volume" :: held 1.586s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created reservations ['30e169bb-e33c-4f9c-a8e3-d6e89ddfcaf6', '1234dd8f-490f-4f82-9709-84dd71b2b74d', 'f9a8bbf4-9559-476c-887c-3d724cdc05c7', '3c200d69-a46d-46f5-a23c-167969a72695'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:01 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:01 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:01 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.511s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Deleted volume successfully.
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b5f9f245-aebe-4f09-ac04-eb084455eac3 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-d8e019a0-c5ec-41b9-939c-f4af230de753-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-3881ce8d-6e47-48cf-a491-278ec8dd992b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-3881ce8d-6e47-48cf-a491-278ec8dd992b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-3881ce8d-6e47-48cf-a491-278ec8dd992b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-3881ce8d-6e47-48cf-a491-278ec8dd992b" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d731037-37b5-4686-af03-87a3a9aef2b4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:02 devstack sudo[108172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b
Nov 05 12:14:02 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Acquiring lock "cinder-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Lock "cinder-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Acquiring lock "cinder-quobyte-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Lock "cinder-quobyte-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e6e3bf-d616-472e-8a16-60f63a70cc01]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:02 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe
Nov 05 12:14:02 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:02 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b" returned: 0 in 0.935s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:02 devstack sudo[108181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b
Nov 05 12:14:02 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe" returned: 0 in 0.717s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:03 devstack sudo[108184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe
Nov 05 12:14:03 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-3881ce8d-6e47-48cf-a491-278ec8dd992b" returned: 0 in 0.497s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-3881ce8d-6e47-48cf-a491-278ec8dd992b" released by "delete_volume" :: held 1.529s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created reservations ['e49d2b66-8543-410c-af29-406cb71269ea', 'fd8a7cee-91d3-449f-b15a-31e8659eb900', 'f0c63e81-ed7d-4f09-b5f8-c57c1679e9b5', 'a45dd315-f6ec-4482-9b40-0a63b37618fb'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:03 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:03 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Lock "cinder-quobyte-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe" released by "delete_volume" :: held 1.445s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Created reservations ['5f7bd7fe-f0e2-4fe5-900a-a7cbf8c46215', '92be3a78-516a-432c-93a5-c4b9a27f293e', '37cd2383-cefb-477d-8afc-240b31bfd191', '66672cbc-928c-4c22-b799-0b0471c7171a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:04 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:04 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:04 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.578s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Deleted volume successfully.
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-87076cf6-c371-46d3-86f9-564a5e5f2ea9 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-3881ce8d-6e47-48cf-a491-278ec8dd992b-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc9e1a-98ea-401c-9a97-e3956d85dd1b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:04 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.760s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Deleted volume successfully.
Nov 05 12:14:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-22c1fd33-3b50-42a2-85c1-ec30dcf8c85a tempest-VolumeImageDependencyTests-417344748 None] Lock "cinder-6bee0616-c4b5-4518-9cfc-7d963cd2a0fe-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:05 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec
Nov 05 12:14:05 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (4e009497-2e2b-448f-be61-1e5f8c392f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:05 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93368fd-51bf-48e9-890f-dd07d95deb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec" returned: 0 in 0.939s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93368fd-51bf-48e9-890f-dd07d95deb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809555134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc87274-ca89-4483-adaf-6cbce15f1e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:06Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46a8355-222c-4255-8ce0-1323585e8f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46a8355-222c-4255-8ce0-1323585e8f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a6dc01-98a0-40b4-82d4-80b10330a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a6dc01-98a0-40b4-82d4-80b10330a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc87274-ca89-4483-adaf-6cbce15f1e8c', 'volume_name': 'volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd770af-daa1-485b-ad76-77132cfc041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd770af-daa1-485b-ad76-77132cfc041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9be07b-f627-4013-9d75-078f648ee61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Volume bfc87274-ca89-4483-adaf-6cbce15f1e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c', 'volume_size': 1}
Nov 05 12:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:05 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec
Nov 05 12:14:05 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:06 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169" returned: 0 in 9.485s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527, size 1024.00 MB, duration 9.49 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:14:06 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:06 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Converted 1024.00 MB image at 107.95 MB/s
Nov 05 12:14:06 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169 is being set with open permissions: ugo+rw
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec" returned: 0 in 0.645s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec" released by "delete_volume" :: held 1.685s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:06 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169
Nov 05 12:14:06 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created reservations ['90838889-e590-47a1-9855-d1d8b8f7a934', '80a736b5-56a3-4447-80d2-abf90c33fcec', 'ae409bbb-e07f-4694-8174-a0fa1a13f9a7', '0fcab3bd-c974-47f8-802f-79988f9f5362'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:06 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:06 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:06 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-e822467a-db53-4cff-84b0-e5abba5ff169" released by "_copy_volume_from_snapshot" :: held 10.870s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-9994710a-a713-41f1-949e-c90602e4a64f-e822467a-db53-4cff-84b0-e5abba5ff169" released by "_create_volume_from_snapshot" :: held 10.958s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.996s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809555134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc87274-ca89-4483-adaf-6cbce15f1e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:06Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Creating volume bfc87274-ca89-4483-adaf-6cbce15f1e8c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:06 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:06 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c 1073741824
Nov 05 12:14:06 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb67fc9c-4fac-4e00-9828-e9e0ff75f57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e822467a-db53-4cff-84b0-e5abba5ff169', 'volume_size': 1, 'snapshot_id': '9994710a-a713-41f1-949e-c90602e4a64f'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8a1f19-1a93-4679-abf5-a7732ebb4d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Volume volume-e822467a-db53-4cff-84b0-e5abba5ff169 (e822467a-db53-4cff-84b0-e5abba5ff169): created successfully
Nov 05 12:14:06 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8a1f19-1a93-4679-abf5-a7732ebb4d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Flow 'volume_create_manager' (f335d8be-cbdb-4a85-9f34-fdc435f760c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Deleted volume successfully.
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-360ca274-5e15-4863-b4c0-1ce976586b79-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-354fb452-3e19-452f-a29e-a435417a6a4c tempest-VolumeDependencyTests-1182641893 None] Created volume successfully.
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e20cfbff-a956-440f-9d87-6e73e5cc0a72 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-113d5cbb-d4ff-44d3-abfc-2e3dcfa6bcec-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-360ca274-5e15-4863-b4c0-1ce976586b79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-e8253707-9d01-40ce-a509-fda249670634" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-e8253707-9d01-40ce-a509-fda249670634" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-360ca274-5e15-4863-b4c0-1ce976586b79" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-360ca274-5e15-4863-b4c0-1ce976586b79" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Deleting offline snapshot 360ca274-5e15-4863-b4c0-1ce976586b79 of volume e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] snapshot_file for this snap is: volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04191cf3-6496-4dce-a8e2-d62e5c86c605]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:07 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79
Nov 05 12:14:07 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:07 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c 1073741824" returned: 0 in 0.521s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:07 devstack sudo[108253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c
Nov 05 12:14:07 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:07 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8253707-9d01-40ce-a509-fda249670634(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c047bab-8842-4598-bfae-ef98eb63979d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:07 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:07 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634
Nov 05 12:14:07 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9be07b-f627-4013-9d75-078f648ee61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401560f7-1596-46d4-a773-96ee136c5660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-9994710a-a713-41f1-949e-c90602e4a64f-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Volume volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c (bfc87274-ca89-4483-adaf-6cbce15f1e8c): created successfully
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401560f7-1596-46d4-a773-96ee136c5660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (4e009497-2e2b-448f-be61-1e5f8c392f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-9994710a-a713-41f1-949e-c90602e4a64f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-quobyte-55a2862f-d9bd-4299-a67c-c77012a3d527" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a19f4b37-f9c9-41b6-a1ab-64ec703f5e6f tempest-ProjectReaderTests-56278109 None] Created volume successfully.
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-55a2862f-d9bd-4299-a67c-c77012a3d527" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-quobyte-9994710a-a713-41f1-949e-c90602e4a64f" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-9994710a-a713-41f1-949e-c90602e4a64f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Deleting offline snapshot 9994710a-a713-41f1-949e-c90602e4a64f of volume 55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] snapshot_file for this snap is: volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7bd647-c7d8-440a-92c1-daf1ceaedbd4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:07 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f
Nov 05 12:14:07 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:07 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:08 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79
Nov 05 12:14:08 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:08 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55a2862f-d9bd-4299-a67c-c77012a3d527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[333324b6-d421-4d62-960f-fb4194632d5d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:08 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79" returned: 0 in 0.374s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:08 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79
Nov 05 12:14:08 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:08 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527
Nov 05 12:14:08 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:08 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634.360ca274-5e15-4863-b4c0-1ce976586b79" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-360ca274-5e15-4863-b4c0-1ce976586b79" released by "_delete_snapshot" :: held 1.777s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-e8253707-9d01-40ce-a509-fda249670634" released by "delete_snapshot" :: held 1.803s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-bfc87274-ca89-4483-adaf-6cbce15f1e8c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Lock "cinder-bfc87274-ca89-4483-adaf-6cbce15f1e8c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created reservations ['eda956ec-b8c6-4dcc-8778-583ecd521536', '4804cf25-6550-47ad-be13-4cebff9c9fe2', '4f0d6f00-09a2-4902-93de-ecd97007ddea', '6153f7aa-1609-449f-a446-c880cd4b853a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-quobyte-bfc87274-ca89-4483-adaf-6cbce15f1e8c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-bfc87274-ca89-4483-adaf-6cbce15f1e8c" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:08 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527" returned: 0 in 0.651s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df942a57-bcf0-449a-ba5c-4e3b55a4070b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:08 devstack sudo[108282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f
Nov 05 12:14:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Delete snapshot completed successfully.
Nov 05 12:14:08 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bec3cda8-ffd8-49c7-8713-977532ff53ad tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-360ca274-5e15-4863-b4c0-1ce976586b79-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:09 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c
Nov 05 12:14:09 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-e8253707-9d01-40ce-a509-fda249670634-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-e8253707-9d01-40ce-a509-fda249670634-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "cinder-quobyte-e8253707-9d01-40ce-a509-fda249670634" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-e8253707-9d01-40ce-a509-fda249670634" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d20fa8-84da-46f2-952b-a6e07183a3eb]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Flow 'volume_create_manager' (bfc52c03-a629-4e66-8ebd-26f201f90d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a2800d-a5cd-40f0-9507-2a9411c647da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:09 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634
Nov 05 12:14:09 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:09 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:09 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a2800d-a5cd-40f0-9507-2a9411c647da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec1a944-e8c2-48de-97c8-233f20fdc500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560a2c733e444696a772196e313af798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:09Z,use_quota=True,user_id='96e2fc80a1074daf86e5ba08c6a5f4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60a1696-d5d7-4a14-acdb-fcafacf15c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60a1696-d5d7-4a14-acdb-fcafacf15c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:09 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c
Nov 05 12:14:09 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7623803-ec0f-4965-b99f-d7c6970788d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7623803-ec0f-4965-b99f-d7c6970788d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec1a944-e8c2-48de-97c8-233f20fdc500', 'volume_name': 'volume-cec1a944-e8c2-48de-97c8-233f20fdc500', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12b0a4f-e287-4a70-9123-e2e7f8c2666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12b0a4f-e287-4a70-9123-e2e7f8c2666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b62c6e2-0720-41a1-8d98-157116720bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Volume cec1a944-e8c2-48de-97c8-233f20fdc500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec1a944-e8c2-48de-97c8-233f20fdc500', 'volume_size': 1}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec1a944-e8c2-48de-97c8-233f20fdc500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560a2c733e444696a772196e313af798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:09Z,use_quota=True,user_id='96e2fc80a1074daf86e5ba08c6a5f4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Creating volume cec1a944-e8c2-48de-97c8-233f20fdc500 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:09 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f" returned: 0 in 0.583s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:09 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500 1073741824
Nov 05 12:14:09 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:09 devstack sudo[108297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f
Nov 05 12:14:09 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:09 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:09 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-bfc87274-ca89-4483-adaf-6cbce15f1e8c" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:09 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634
Nov 05 12:14:09 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-bfc87274-ca89-4483-adaf-6cbce15f1e8c" released by "delete_volume" :: held 0.857s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:09 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527.9994710a-a713-41f1-949e-c90602e4a64f" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Created reservations ['a6ac233e-f492-4593-adb4-22d4a26e1b73', 'd3e182ab-9d32-4c74-b557-174c2bf1da60', 'f9c26f44-7dbc-4950-ad2c-e416bafad95d', '8a848a1e-8ac7-4054-aebe-4554c83c9607'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-9994710a-a713-41f1-949e-c90602e4a64f" released by "_delete_snapshot" :: held 2.109s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-55a2862f-d9bd-4299-a67c-c77012a3d527" released by "delete_snapshot" :: held 2.147s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:10 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:10 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Created reservations ['41ac3341-77ed-474c-85c2-bb1425fa3066', '6f5a9ec2-cc5f-41f2-8bcf-22e00842767a', '9f969863-425f-450e-a636-22dc93cb1fea', 'd304334a-09ce-4135-ae1d-af0ac3883237'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:10 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8253707-9d01-40ce-a509-fda249670634" returned: 0 in 0.328s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:10 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-quobyte-e8253707-9d01-40ce-a509-fda249670634" released by "delete_volume" :: held 0.894s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500 1073741824" returned: 0 in 0.603s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Delete snapshot completed successfully.
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7876abaf-c919-4291-93ee-877ae4bba0e7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-9994710a-a713-41f1-949e-c90602e4a64f-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Created reservations ['4069fff1-ab51-4ded-a4d1-6c337ca50216', 'e5c408ca-f526-40b4-bfe0-c5c3e31be92e', '6701a226-8951-4e2b-afd2-21326748530f', '3a1194e9-4062-403c-aacf-12def3d8a26e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:10 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500
Nov 05 12:14:10 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:10 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:10 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:10 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Deleted volume successfully.
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-58b1f0fd-e437-4d28-ab59-ec786c18203c tempest-ProjectReaderTests-56278109 None] Lock "cinder-bfc87274-ca89-4483-adaf-6cbce15f1e8c-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:10 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b62c6e2-0720-41a1-8d98-157116720bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec1a944-e8c2-48de-97c8-233f20fdc500', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d8477d-bb70-4dc6-b648-0b8a53cf07ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Volume volume-cec1a944-e8c2-48de-97c8-233f20fdc500 (cec1a944-e8c2-48de-97c8-233f20fdc500): created successfully
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d8477d-bb70-4dc6-b648-0b8a53cf07ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Flow 'volume_create_manager' (bfc52c03-a629-4e66-8ebd-26f201f90d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-de40ca1f-5a03-4f1b-adb7-7606d6d99491 tempest-CinderUnicodeTest-1930631235 None] Created volume successfully.
Nov 05 12:14:10 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Deleted volume successfully.
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (fce4f962-fe63-4bf2-9588-1cb713877a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd768c6-33c3-4202-8479-d94d994ec371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8ad21c23-80c6-455b-812a-40ecadc52dc2 tempest-CreateVolumesFromSnapshotTest-1288632902 None] Lock "cinder-e8253707-9d01-40ce-a509-fda249670634-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd768c6-33c3-4202-8479-d94d994ec371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412122906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f7219a-5e00-4aeb-9cf2-b5422db04be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:11Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30068888-87d6-4656-bc6e-05365c427a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30068888-87d6-4656-bc6e-05365c427a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5736608a-483c-440c-b8ef-25b83dcd36a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5736608a-483c-440c-b8ef-25b83dcd36a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f7219a-5e00-4aeb-9cf2-b5422db04be0', 'volume_name': 'volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9010bc4-f856-451d-89fb-5510168dbd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9010bc4-f856-451d-89fb-5510168dbd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43356549-2c3f-4f23-8c9d-0ab0a0afdaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Volume 95f7219a-5e00-4aeb-9cf2-b5422db04be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0', 'volume_size': 1}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412122906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f7219a-5e00-4aeb-9cf2-b5422db04be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:11Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Creating volume 95f7219a-5e00-4aeb-9cf2-b5422db04be0 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:10 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:10 devstack sudo[108322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0 1073741824
Nov 05 12:14:10 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-55a2862f-d9bd-4299-a67c-c77012a3d527-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-55a2862f-d9bd-4299-a67c-c77012a3d527-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-quobyte-55a2862f-d9bd-4299-a67c-c77012a3d527" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-55a2862f-d9bd-4299-a67c-c77012a3d527" acquired by "delete_volume" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56290ff-852d-40d1-a0e2-defe84d379f0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:11 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527
Nov 05 12:14:11 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:11 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0 1073741824" returned: 0 in 0.539s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:11 devstack sudo[108331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0
Nov 05 12:14:11 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:11 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527" returned: 0 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:11 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527
Nov 05 12:14:11 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:11 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43356549-2c3f-4f23-8c9d-0ab0a0afdaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ebf324-28a4-469a-a2c0-74d09bc087d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Volume volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0 (95f7219a-5e00-4aeb-9cf2-b5422db04be0): created successfully
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ebf324-28a4-469a-a2c0-74d09bc087d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (fce4f962-fe63-4bf2-9588-1cb713877a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ba9f8d2b-c48c-4b2f-b438-d70ca920c489 tempest-ProjectReaderTests-56278109 None] Created volume successfully.
Nov 05 12:14:11 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-55a2862f-d9bd-4299-a67c-c77012a3d527" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-55a2862f-d9bd-4299-a67c-c77012a3d527" released by "delete_volume" :: held 0.882s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Created reservations ['95069699-2714-4c1e-a186-9b5838aed6d1', '89af7e91-830b-4764-98f1-923a73ca8f8d', 'a1aabd53-88da-4cc2-b195-a32e16eedf0f', 'b6de8511-501b-47fc-a8ee-26a2a1d1773b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-e822467a-db53-4cff-84b0-e5abba5ff169-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:12 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:12 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-e822467a-db53-4cff-84b0-e5abba5ff169-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Flow 'volume_create_manager' (c211a7cd-bd61-43b3-a014-375f38642bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8631ea71-dc75-4151-bbeb-7449997bd34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8631ea71-dc75-4151-bbeb-7449997bd34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1921441545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649ca08e-d188-484b-be72-fffae0288a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560a2c733e444696a772196e313af798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:12Z,use_quota=True,user_id='96e2fc80a1074daf86e5ba08c6a5f4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6e7d55-e74f-425f-8ab0-cf63681f4741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6e7d55-e74f-425f-8ab0-cf63681f4741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25cb2d7-dc5c-4bf2-88bd-23a135b47712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25cb2d7-dc5c-4bf2-88bd-23a135b47712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649ca08e-d188-484b-be72-fffae0288a64', 'volume_name': 'volume-649ca08e-d188-484b-be72-fffae0288a64', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79489a7-9bf4-479c-a1ee-0180a157eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79489a7-9bf4-479c-a1ee-0180a157eea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7a0eb0-3d10-4771-b628-dd0ccd13da15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Volume 649ca08e-d188-484b-be72-fffae0288a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649ca08e-d188-484b-be72-fffae0288a64', 'volume_size': 1}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1921441545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649ca08e-d188-484b-be72-fffae0288a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560a2c733e444696a772196e313af798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:12Z,use_quota=True,user_id='96e2fc80a1074daf86e5ba08c6a5f4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Creating volume 649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:12 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:12 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 1073741824
Nov 05 12:14:12 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "cinder-quobyte-e822467a-db53-4cff-84b0-e5abba5ff169" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-e822467a-db53-4cff-84b0-e5abba5ff169" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:12 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.310s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[11915d6a-0c4f-40c9-a3b1-e89d5cdaa91c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Deleted volume successfully.
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d04ce07c-4f40-4c8a-a33f-8f333c3c60a7 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-55a2862f-d9bd-4299-a67c-c77012a3d527-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:12 devstack sudo[108345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169
Nov 05 12:14:12 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-95f7219a-5e00-4aeb-9cf2-b5422db04be0-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Lock "cinder-95f7219a-5e00-4aeb-9cf2-b5422db04be0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-quobyte-95f7219a-5e00-4aeb-9cf2-b5422db04be0" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-95f7219a-5e00-4aeb-9cf2-b5422db04be0" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[790e4867-ad5e-4a2c-9192-a8912488ffc8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:12 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169" returned: 0 in 0.496s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 1073741824" returned: 0 in 0.616s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169
Nov 05 12:14:13 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64
Nov 05 12:14:13 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack sudo[108354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0
Nov 05 12:14:13 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e822467a-db53-4cff-84b0-e5abba5ff169" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-quobyte-e822467a-db53-4cff-84b0-e5abba5ff169" released by "delete_volume" :: held 0.877s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Created reservations ['e8fd8162-6e2f-468c-88ae-cc6b60fc313b', 'fda59fec-9346-4605-b7e2-dc3de5e7b2f8', '8584e07c-0fae-4912-a2c3-51bdde58132b', '85a8f082-7edc-45ea-8cfd-bccd82e0b360'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:13 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:13 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0" returned: 0 in 0.490s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7a0eb0-3d10-4771-b628-dd0ccd13da15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649ca08e-d188-484b-be72-fffae0288a64', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d6546-3964-4b44-b330-fbacc352f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:13 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0
Nov 05 12:14:13 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Volume volume-649ca08e-d188-484b-be72-fffae0288a64 (649ca08e-d188-484b-be72-fffae0288a64): created successfully
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d6546-3964-4b44-b330-fbacc352f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Flow 'volume_create_manager' (c211a7cd-bd61-43b3-a014-375f38642bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-514d938b-6fca-4502-83a1-1ca17d296ab7 tempest-CinderUnicodeTest-1930631235 None] Created volume successfully.
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack sudo[108367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:13 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95f7219a-5e00-4aeb-9cf2-b5422db04be0" returned: 0 in 0.300s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-95f7219a-5e00-4aeb-9cf2-b5422db04be0" released by "delete_volume" :: held 0.859s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Created reservations ['b4ce4c41-e5c5-4782-aa06-fc43bbf4c622', 'a779eaed-3a2d-4bdf-bb82-126efc0be604', '8b93d42e-4c64-4576-acd9-6cfad27e8f97', '64334441-532b-4702-8f0a-b6aa09b267c4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:13 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Deleted volume successfully.
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-549357a3-55e0-4269-bb99-9002899660f2 tempest-VolumeDependencyTests-1182641893 None] Lock "cinder-e822467a-db53-4cff-84b0-e5abba5ff169-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack sudo[108371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:13 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:14 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Deleted volume successfully.
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-881eb749-e582-4b5d-a697-80348d4986e6 tempest-ProjectReaderTests-56278109 None] Lock "cinder-95f7219a-5e00-4aeb-9cf2-b5422db04be0-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (22bc7cf9-0098-4e78-9a1f-5cce52f33352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1357d54-33c0-4ff9-91a6-40ace895f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9c6627a2-b0ba-49fa-bc2e-d234a9687cdb tempest-ProjectAdminTests-169714432 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4731140136719, 'free_capacity_gb': 1773.4731140136719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1357d54-33c0-4ff9-91a6-40ace895f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045893295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6ee226-9ced-4e59-baad-153b24914120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:15Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ac4009-7d5e-4c2b-8972-575b8d40a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ac4009-7d5e-4c2b-8972-575b8d40a32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240512d7-ad2b-4a0b-985e-1c970ea488be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240512d7-ad2b-4a0b-985e-1c970ea488be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6ee226-9ced-4e59-baad-153b24914120', 'volume_name': 'volume-0e6ee226-9ced-4e59-baad-153b24914120', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ee70c6-32ac-4ea2-bc92-36e8b154902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ee70c6-32ac-4ea2-bc92-36e8b154902c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79283a10-ee22-43de-acdd-a7ca627ffbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Volume 0e6ee226-9ced-4e59-baad-153b24914120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6ee226-9ced-4e59-baad-153b24914120', 'volume_size': 1}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045893295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6ee226-9ced-4e59-baad-153b24914120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:15Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Creating volume 0e6ee226-9ced-4e59-baad-153b24914120 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:14 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:14 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120 1073741824
Nov 05 12:14:14 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:15 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120 1073741824" returned: 0 in 0.530s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:15 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120
Nov 05 12:14:15 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:15 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.792s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79283a10-ee22-43de-acdd-a7ca627ffbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6ee226-9ced-4e59-baad-153b24914120', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e73597-2742-4b77-87ee-716df1b54cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Creating offline snapshot 1dcc2eaf-ad58-49e0-8feb-6f6006c76931 of volume 649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Volume volume-0e6ee226-9ced-4e59-baad-153b24914120 (0e6ee226-9ced-4e59-baad-153b24914120): created successfully
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e73597-2742-4b77-87ee-716df1b54cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (22bc7cf9-0098-4e78-9a1f-5cce52f33352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07de46e-6cc9-4ffd-a785-bdeef9d106d4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2547ff71-592a-4d21-864b-359fef289b59 tempest-ProjectReaderTests-56278109 None] Created volume successfully.
Nov 05 12:14:15 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64
Nov 05 12:14:15 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:16 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64" returned: 0 in 0.461s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:16 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 1G
Nov 05 12:14:16 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:16 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 1G" returned: 0 in 0.539s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649ca08e-d188-484b-be72-fffae0288a64 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:16 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649ca08e-d188-484b-be72-fffae0288a64 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931
Nov 05 12:14:16 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-0e6ee226-9ced-4e59-baad-153b24914120-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Lock "cinder-0e6ee226-9ced-4e59-baad-153b24914120-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=222,cinder:UPDATE=289,cinder:INSERT=73,cinder:DELETE=24 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-quobyte-0e6ee226-9ced-4e59-baad-153b24914120" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-0e6ee226-9ced-4e59-baad-153b24914120" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c731c0-ef1e-46fa-af60-e81a538479c1]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:17 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120
Nov 05 12:14:17 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:17 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649ca08e-d188-484b-be72-fffae0288a64 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:17 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 is being set with open permissions: ugo+rw
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:17 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931
Nov 05 12:14:17 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:17 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:17 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:17 devstack sudo[108410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:17 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=208,cinder:UPDATE=316,cinder:DELETE=31,cinder:INSERT=84 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:17 devstack sudo[108412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.info
Nov 05 12:14:17 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:17 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0e6ee226-9ced-4e59-baad-153b24914120" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-0e6ee226-9ced-4e59-baad-153b24914120" released by "delete_volume" :: held 0.850s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:17 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.info" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:17 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.info is being set with open permissions: ugo+rw
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:17 devstack sudo[108416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.info
Nov 05 12:14:17 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Created reservations ['9e98669f-d25f-4d19-9281-8ceeadf6331a', '3b037a70-66c2-4561-8fad-afea900ca6fd', 'a45961af-6271-4436-a60b-826db4b31b0a', '12ff7e13-8c7f-4ff4-8251-58859c168b3c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:17 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:17 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:18 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.info" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a7296e26-af5a-47d8-ba33-6075e172e479 tempest-CinderUnicodeTest-1930631235 None] Create snapshot completed successfully
Nov 05 12:14:18 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Deleted volume successfully.
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-798603a9-e2db-4772-a29c-3a218125dc6e tempest-ProjectReaderTests-56278109 None] Lock "cinder-0e6ee226-9ced-4e59-baad-153b24914120-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (49a68027-be54-4b36-a02e-82c9719ddd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d015776-db00-477d-8fc0-c9dfa69f59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d015776-db00-477d-8fc0-c9dfa69f59de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723394202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0fe869-df04-45db-9924-8bcd00783eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:19Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0261391a-38ca-446a-ba65-a7c2eea19c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0261391a-38ca-446a-ba65-a7c2eea19c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40892b6d-84eb-4db2-88a1-ae1c2379cc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40892b6d-84eb-4db2-88a1-ae1c2379cc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0fe869-df04-45db-9924-8bcd00783eec', 'volume_name': 'volume-ce0fe869-df04-45db-9924-8bcd00783eec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc9b288-d7b9-4e86-9276-4cd2de6a408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc9b288-d7b9-4e86-9276-4cd2de6a408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc1ace7-9aa4-4a40-8778-68381c2b7492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Volume ce0fe869-df04-45db-9924-8bcd00783eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0fe869-df04-45db-9924-8bcd00783eec', 'volume_size': 1}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723394202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0fe869-df04-45db-9924-8bcd00783eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4e92b088341d189eb544f259cfe36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:19Z,use_quota=True,user_id='3230f940a0c9464996da99c73757505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Creating volume ce0fe869-df04-45db-9924-8bcd00783eec {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:18 devstack sudo[108422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec 1073741824
Nov 05 12:14:18 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "cinder-1dcc2eaf-ad58-49e0-8feb-6f6006c76931-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-1dcc2eaf-ad58-49e0-8feb-6f6006c76931-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "cinder-quobyte-649ca08e-d188-484b-be72-fffae0288a64" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-649ca08e-d188-484b-be72-fffae0288a64" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "cinder-quobyte-1dcc2eaf-ad58-49e0-8feb-6f6006c76931" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-1dcc2eaf-ad58-49e0-8feb-6f6006c76931" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Deleting offline snapshot 1dcc2eaf-ad58-49e0-8feb-6f6006c76931 of volume 649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] snapshot_file for this snap is: volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a561e279-57c3-4717-a933-87bfb43d5905]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:19 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec 1073741824" returned: 0 in 0.600s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:19 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec
Nov 05 12:14:19 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:19 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931
Nov 05 12:14:19 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:19 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc1ace7-9aa4-4a40-8778-68381c2b7492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0fe869-df04-45db-9924-8bcd00783eec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100644e2-47f4-4b15-969b-418a24bb74bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Volume volume-ce0fe869-df04-45db-9924-8bcd00783eec (ce0fe869-df04-45db-9924-8bcd00783eec): created successfully
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100644e2-47f4-4b15-969b-418a24bb74bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Flow 'volume_create_manager' (49a68027-be54-4b36-a02e-82c9719ddd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:19 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-649ca08e-d188-484b-be72-fffae0288a64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-58376b47-fd5e-401e-b8ac-145c40ab5798 tempest-ProjectReaderTests-56278109 None] Created volume successfully.
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c8e47c-83bf-4a7f-b1d4-40824a75b7db]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:19 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64
Nov 05 12:14:19 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:20 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (89b6dcbb-853f-47fa-8d72-e0df3839b2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b796f-a098-4f22-9c7f-3dfc4b403bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64" returned: 0 in 0.454s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b796f-a098-4f22-9c7f-3dfc4b403bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861453767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605f1c9e-2db1-42f3-83e4-7576ddec7fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:20Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:20 devstack sudo[108441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931
Nov 05 12:14:20 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eace0dba-6539-4df3-8200-cd8476fe05b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eace0dba-6539-4df3-8200-cd8476fe05b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6724d8b7-ab53-4584-a18b-202d275b2860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6724d8b7-ab53-4584-a18b-202d275b2860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605f1c9e-2db1-42f3-83e4-7576ddec7fc0', 'volume_name': 'volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e3573-32b4-422a-9525-e7b6a4b76f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e3573-32b4-422a-9525-e7b6a4b76f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de50fcf8-de78-49f9-bcf2-54564bda2a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Volume 605f1c9e-2db1-42f3-83e4-7576ddec7fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0', 'volume_size': 1}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861453767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605f1c9e-2db1-42f3-83e4-7576ddec7fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:20Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Creating volume 605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:20 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:20 devstack sudo[108443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 1073741824
Nov 05 12:14:20 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:20 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-ce0fe869-df04-45db-9924-8bcd00783eec-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:20 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931
Nov 05 12:14:20 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Lock "cinder-ce0fe869-df04-45db-9924-8bcd00783eec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Acquiring lock "cinder-quobyte-ce0fe869-df04-45db-9924-8bcd00783eec" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-ce0fe869-df04-45db-9924-8bcd00783eec" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0216e9c0-817e-401d-9365-80467d6ff7af]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:20 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 1073741824" returned: 0 in 0.570s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:21 devstack sudo[108456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0
Nov 05 12:14:21 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:21 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec
Nov 05 12:14:21 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:21 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64.1dcc2eaf-ad58-49e0-8feb-6f6006c76931" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-1dcc2eaf-ad58-49e0-8feb-6f6006c76931" released by "_delete_snapshot" :: held 1.981s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-649ca08e-d188-484b-be72-fffae0288a64" released by "delete_snapshot" :: held 2.017s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:21 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Created reservations ['85a0a5db-aebe-4303-b950-eb91145b2209', 'e4d23755-61ac-4890-9425-7c67d7543ab4', '090c0fcf-f461-4853-890a-cc6f24021d4d', 'ee51aa2b-9145-49fb-87f1-ef6abc9ebfc1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de50fcf8-de78-49f9-bcf2-54564bda2a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fc87a1-6674-48a8-9d5c-6714c9769ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:21 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Volume volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 (605f1c9e-2db1-42f3-83e4-7576ddec7fc0): created successfully
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fc87a1-6674-48a8-9d5c-6714c9769ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (89b6dcbb-853f-47fa-8d72-e0df3839b2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:21 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cacb17a4-dd56-4396-a54c-68196928e945 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:14:21 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec
Nov 05 12:14:21 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Delete snapshot completed successfully.
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-64a2a4fb-51f0-4dfa-abaf-ef1a582f252d tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-1dcc2eaf-ad58-49e0-8feb-6f6006c76931-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:21 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-ce0fe869-df04-45db-9924-8bcd00783eec" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Lock "cinder-quobyte-ce0fe869-df04-45db-9924-8bcd00783eec" released by "delete_volume" :: held 0.820s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Created reservations ['a1a61dc7-fd4c-4b41-9fdb-e22ae4a50e8a', '80ad9ae9-9fa3-4363-8f3f-ba5ad664630a', '7c237d33-0458-4fbd-9c11-32730ca722af', '71dc54f7-3227-441e-89eb-25bc86867cf3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:21 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:21 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:22 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Deleted volume successfully.
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-31f31c4a-c83e-4009-bddb-480b1c33e18d tempest-ProjectReaderTests-56278109 None] Lock "cinder-ce0fe869-df04-45db-9924-8bcd00783eec-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "cinder-649ca08e-d188-484b-be72-fffae0288a64-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-649ca08e-d188-484b-be72-fffae0288a64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "cinder-quobyte-649ca08e-d188-484b-be72-fffae0288a64" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-649ca08e-d188-484b-be72-fffae0288a64" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e286b-6996-4316-a8cb-20dca77142d4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:22 devstack sudo[108470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64
Nov 05 12:14:22 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot b3b20588-1bbe-4823-8dee-ec2fc48c72c9 of volume 605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[752b3dfb-a617-492a-8365-d0095186b6d0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:23 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:23 devstack sudo[108476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64
Nov 05 12:14:23 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:23 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0
Nov 05 12:14:23 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:23 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-649ca08e-d188-484b-be72-fffae0288a64" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-649ca08e-d188-484b-be72-fffae0288a64" released by "delete_volume" :: held 0.881s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Created reservations ['b4f057f4-f403-42d1-88d7-bc90e746ba58', '1d8fdb67-9f93-48fd-9411-8b2d23335ada', '2c567e7d-d3b8-4cfa-a696-d33b937f138f', '97da8ef9-b30d-4fbd-8d0c-2db12a286002'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:23 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:23 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 1G
Nov 05 12:14:23 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:23 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:23 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "cinder-cec1a944-e8c2-48de-97c8-233f20fdc500-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-cec1a944-e8c2-48de-97c8-233f20fdc500-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "cinder-quobyte-cec1a944-e8c2-48de-97c8-233f20fdc500" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-cec1a944-e8c2-48de-97c8-233f20fdc500" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53228371-58c4-4a7d-925e-e11de03871d4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:24 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.422s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Deleted volume successfully.
Nov 05 12:14:24 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 1G" returned: 0 in 0.571s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4f4e1df-7e79-4559-b90a-5bdd58c3e9ef tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-649ca08e-d188-484b-be72-fffae0288a64-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:24 devstack sudo[108490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500
Nov 05 12:14:24 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:24 devstack sudo[108493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9
Nov 05 12:14:24 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:24 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500" returned: 0 in 0.561s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:24 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:24 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 is being set with open permissions: ugo+rw
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:24 devstack sudo[108503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500
Nov 05 12:14:24 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:24 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9
Nov 05 12:14:24 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:24 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-cec1a944-e8c2-48de-97c8-233f20fdc500" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:24 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-quobyte-cec1a944-e8c2-48de-97c8-233f20fdc500" released by "delete_volume" :: held 0.907s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:24 devstack sudo[108509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.info
Nov 05 12:14:24 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Created reservations ['499323de-6bb0-490f-bd6c-1d74b58f3fea', '0d26b4c1-0658-4218-adfb-3bcda18984a3', '31220a37-dc9d-4779-87c0-79bcb9630fdd', '441b0e16-95bd-441e-b556-212f14aaf7aa'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:24 devstack sudo[108511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:24 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:25 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.info" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:25 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.info is being set with open permissions: ugo+rw
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:25 devstack sudo[108514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.info
Nov 05 12:14:25 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:25 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Deleted volume successfully.
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-643ea9be-bb6c-4ab8-9216-b2750506fbd5 tempest-CinderUnicodeTest-1930631235 None] Lock "cinder-cec1a944-e8c2-48de-97c8-233f20fdc500-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:25 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.info" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9aacc2ff-9f9c-44f0-a011-681b9169a4e6 tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (2e605880-fb48-40ef-988a-e279269fd1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b398e52-ebdc-420b-9dda-55ddd7101135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b398e52-ebdc-420b-9dda-55ddd7101135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520038260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8653e15f-05f3-4c99-9ed3-c69320d624ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:26Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0544b625-ad2a-423a-b9d6-5942d9111872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0544b625-ad2a-423a-b9d6-5942d9111872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7431001-b9a2-4496-af74-d2b56dee5d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7431001-b9a2-4496-af74-d2b56dee5d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8653e15f-05f3-4c99-9ed3-c69320d624ec', 'volume_name': 'volume-8653e15f-05f3-4c99-9ed3-c69320d624ec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747016ea-2604-446a-91d7-bcdc9f071ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747016ea-2604-446a-91d7-bcdc9f071ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185f1893-2d4b-48ff-9d21-244087cfd5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Volume 8653e15f-05f3-4c99-9ed3-c69320d624ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8653e15f-05f3-4c99-9ed3-c69320d624ec', 'volume_size': 1}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520038260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8653e15f-05f3-4c99-9ed3-c69320d624ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:26Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Creating volume 8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:25 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:25 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec 1073741824
Nov 05 12:14:25 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-b3b20588-1bbe-4823-8dee-ec2fc48c72c9-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Lock "cinder-b3b20588-1bbe-4823-8dee-ec2fc48c72c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:26 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec 1073741824" returned: 0 in 0.495s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-b3b20588-1bbe-4823-8dee-ec2fc48c72c9" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-b3b20588-1bbe-4823-8dee-ec2fc48c72c9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot b3b20588-1bbe-4823-8dee-ec2fc48c72c9 of volume 605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86f6681-d4e9-48d8-941b-7080ad4b0b04]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:26 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec
Nov 05 12:14:26 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:26 devstack sudo[108527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9
Nov 05 12:14:26 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:26 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec" returned: 0 in 0.316s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185f1893-2d4b-48ff-9d21-244087cfd5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8653e15f-05f3-4c99-9ed3-c69320d624ec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0a2d4e-2489-4941-a421-11a1f79797b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Volume volume-8653e15f-05f3-4c99-9ed3-c69320d624ec (8653e15f-05f3-4c99-9ed3-c69320d624ec): created successfully
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0a2d4e-2489-4941-a421-11a1f79797b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (2e605880-fb48-40ef-988a-e279269fd1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fcc10e17-aa88-4950-9a4c-ce658cf95d6c tempest-ProjectReaderTests-599163803 None] Created volume successfully.
Nov 05 12:14:26 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9" returned: 0 in 0.428s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd2949a-f342-4f0d-b8af-760c2dd8f6c9]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:26 devstack sudo[108534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0
Nov 05 12:14:26 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:27 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:27 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9
Nov 05 12:14:27 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:27 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:27 devstack sudo[108545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9
Nov 05 12:14:27 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:27 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0.b3b20588-1bbe-4823-8dee-ec2fc48c72c9" returned: 0 in 0.308s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-b3b20588-1bbe-4823-8dee-ec2fc48c72c9" released by "_delete_snapshot" :: held 1.693s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" released by "delete_snapshot" :: held 1.732s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Created reservations ['14d1ccf7-320b-4d08-b2f7-311efe7bc9d7', 'e2e726d0-9520-481b-877c-136ffb67c4bc', 'c8a27aa4-3302-465a-8566-5a23cbcfb727', '1ca88c7d-9ade-4e70-b1e2-1508e6604fd9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Creating offline snapshot 99c22b82-bea0-4a99-b25d-aaac8a1e97f1 of volume 8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c640a1-7216-4ba8-b6fb-8267b9e4d4b0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-12136558-c265-4f77-90ea-9d76f9ba25ee tempest-ProjectMemberTests-1471482416 None] Lock "cinder-b3b20588-1bbe-4823-8dee-ec2fc48c72c9-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:28 devstack sudo[108548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec
Nov 05 12:14:28 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-605f1c9e-2db1-42f3-83e4-7576ddec7fc0-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-605f1c9e-2db1-42f3-83e4-7576ddec7fc0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0a3bd-858e-414d-b7af-619351386124]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:28 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec" returned: 0 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:28 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 1G
Nov 05 12:14:28 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:28 devstack sudo[108553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0
Nov 05 12:14:28 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:28 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:28 devstack sudo[108566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0
Nov 05 12:14:28 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:29 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 1G" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8653e15f-05f3-4c99-9ed3-c69320d624ec -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:29 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8653e15f-05f3-4c99-9ed3-c69320d624ec -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1
Nov 05 12:14:29 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:29 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-605f1c9e-2db1-42f3-83e4-7576ddec7fc0" released by "delete_volume" :: held 0.793s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Created reservations ['91242adb-dfd1-4dcf-9bcd-dfd746c8a4ea', '9bdfdf40-9d25-4f62-a735-4cfb326a8aa2', '5c57ea39-9a27-4e99-a2cc-213cf51fdb72', 'f397101a-6442-41c4-8126-eee8e9ad2eab'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:29 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8653e15f-05f3-4c99-9ed3-c69320d624ec -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:29 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 is being set with open permissions: ugo+rw
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:29 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1
Nov 05 12:14:29 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:29 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:29 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:29 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:29 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a6c5aa-32cf-4ae3-a329-96dc6c21f932 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-605f1c9e-2db1-42f3-83e4-7576ddec7fc0-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:29 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.info
Nov 05 12:14:29 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:29 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.info" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:29 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.info is being set with open permissions: ugo+rw
Nov 05 12:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:30 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.info
Nov 05 12:14:30 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (48792082-0a0e-4270-b39d-611f60ed7c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4773eec3-7dab-48c8-8575-8d0402b9c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4773eec3-7dab-48c8-8575-8d0402b9c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672848594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1245f9-59d7-4002-a272-3256080a8d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:30Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced23c1b-82dd-4f78-9d71-ff623bf77a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced23c1b-82dd-4f78-9d71-ff623bf77a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2852c7a4-2b00-4ffa-9b47-8bad50b175cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2852c7a4-2b00-4ffa-9b47-8bad50b175cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1245f9-59d7-4002-a272-3256080a8d4c', 'volume_name': 'volume-6f1245f9-59d7-4002-a272-3256080a8d4c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a476a28a-c412-4f95-a9be-5b6848f3b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a476a28a-c412-4f95-a9be-5b6848f3b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c363693a-334f-4146-8d3f-a4f6b5c0a83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Volume 6f1245f9-59d7-4002-a272-3256080a8d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1245f9-59d7-4002-a272-3256080a8d4c', 'volume_size': 1}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:30 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.info" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672848594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1245f9-59d7-4002-a272-3256080a8d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:30Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Creating volume 6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:30 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:30 devstack sudo[108588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c 1073741824
Nov 05 12:14:30 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0444b28f-baf4-4fdf-aae6-9c9a2eb8f071 tempest-ProjectReaderTests-599163803 None] Create snapshot completed successfully
Nov 05 12:14:30 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c 1073741824" returned: 0 in 0.479s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:30 devstack sudo[108594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c
Nov 05 12:14:30 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:31 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c363693a-334f-4146-8d3f-a4f6b5c0a83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1245f9-59d7-4002-a272-3256080a8d4c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eb9393-48de-41e5-b57a-9157189ba5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:31 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Volume volume-6f1245f9-59d7-4002-a272-3256080a8d4c (6f1245f9-59d7-4002-a272-3256080a8d4c): created successfully
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eb9393-48de-41e5-b57a-9157189ba5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (48792082-0a0e-4270-b39d-611f60ed7c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e51df48b-a03b-46da-ba93-8b077c2f61e4 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-99c22b82-bea0-4a99-b25d-aaac8a1e97f1-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Lock "cinder-99c22b82-bea0-4a99-b25d-aaac8a1e97f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-8653e15f-05f3-4c99-9ed3-c69320d624ec" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-8653e15f-05f3-4c99-9ed3-c69320d624ec" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-99c22b82-bea0-4a99-b25d-aaac8a1e97f1" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-99c22b82-bea0-4a99-b25d-aaac8a1e97f1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Deleting offline snapshot 99c22b82-bea0-4a99-b25d-aaac8a1e97f1 of volume 8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] snapshot_file for this snap is: volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1e1d61-0e35-42ad-b9b1-6fc5a473a508]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:31 devstack sudo[108597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1
Nov 05 12:14:31 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:31 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1" returned: 0 in 0.370s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8653e15f-05f3-4c99-9ed3-c69320d624ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c4a28b-241f-4cfb-bbeb-36d2bd124d4d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:31 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec
Nov 05 12:14:31 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot d520497c-98d8-44d5-af79-6ed22a8019a6 of volume 6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:32 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec" returned: 0 in 0.443s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4556c9ee-82ac-4f1a-beaf-3effda479000]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:32 devstack sudo[108607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1
Nov 05 12:14:32 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:32 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c
Nov 05 12:14:32 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:32 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:32 devstack sudo[108618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1
Nov 05 12:14:32 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:32 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c" returned: 0 in 0.446s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:32 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 1G
Nov 05 12:14:32 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:32 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec.99c22b82-bea0-4a99-b25d-aaac8a1e97f1" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-99c22b82-bea0-4a99-b25d-aaac8a1e97f1" released by "_delete_snapshot" :: held 1.609s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-8653e15f-05f3-4c99-9ed3-c69320d624ec" released by "delete_snapshot" :: held 1.637s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Created reservations ['ef5dc1b3-8267-46ab-a82e-ddebd977703e', '1468b424-943c-4b15-8b4e-e52813d23acd', '2e4dbb3b-d7eb-411a-8e0e-d44929b50238', '0a277106-c3b7-4ef6-bb15-87568e1102b4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Delete snapshot completed successfully.
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a01b37-d4c5-40ad-926a-0ac9f954b302 tempest-ProjectReaderTests-599163803 None] Lock "cinder-99c22b82-bea0-4a99-b25d-aaac8a1e97f1-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:33 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 1G" returned: 0 in 0.509s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f1245f9-59d7-4002-a272-3256080a8d4c -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:33 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f1245f9-59d7-4002-a272-3256080a8d4c -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6
Nov 05 12:14:33 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-8653e15f-05f3-4c99-9ed3-c69320d624ec-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Lock "cinder-8653e15f-05f3-4c99-9ed3-c69320d624ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-8653e15f-05f3-4c99-9ed3-c69320d624ec" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-8653e15f-05f3-4c99-9ed3-c69320d624ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:33 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f1245f9-59d7-4002-a272-3256080a8d4c -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:33 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 is being set with open permissions: ugo+rw
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f8fb8-910c-407a-9a27-ed3666b54aed]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:33 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6
Nov 05 12:14:33 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:33 devstack sudo[108632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec
Nov 05 12:14:33 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:33 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:33 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.info
Nov 05 12:14:33 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:34 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:34 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec
Nov 05 12:14:34 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:34 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.info" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:34 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.info is being set with open permissions: ugo+rw
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:34 devstack sudo[108646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.info
Nov 05 12:14:34 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:34 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-8653e15f-05f3-4c99-9ed3-c69320d624ec" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-8653e15f-05f3-4c99-9ed3-c69320d624ec" released by "delete_volume" :: held 0.760s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Created reservations ['32af19d6-b343-4a88-86d3-e02e9363aa23', 'cdf152c6-2722-4036-8eeb-03898513cff2', 'ed3e5b27-b2be-49f4-bc69-85b48d1d6332', 'c3ec6a73-1046-4633-84f6-1c2edd709309'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:34 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.info" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b5626de1-e83b-4ec0-ae04-2a78def848f1 tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:14:34 devstack sudo[108650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:34 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:34 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Deleted volume successfully.
Nov 05 12:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-25c06887-6597-4e95-a1fd-09ce961045b5 tempest-ProjectReaderTests-599163803 None] Lock "cinder-8653e15f-05f3-4c99-9ed3-c69320d624ec-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (c884611a-202b-46bd-a4ef-07aa70449503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d424e47e-4a8b-40ef-a20e-d74eb0c984ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d424e47e-4a8b-40ef-a20e-d74eb0c984ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521246403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9586708d-55a9-4410-823a-2a01b214dc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:35Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa107e0b-c826-49df-83f8-1141ead7160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa107e0b-c826-49df-83f8-1141ead7160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb77ab14-50ff-46ac-b852-ee7df5ee8279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb77ab14-50ff-46ac-b852-ee7df5ee8279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9586708d-55a9-4410-823a-2a01b214dc35', 'volume_name': 'volume-9586708d-55a9-4410-823a-2a01b214dc35', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62ac57e-5e63-42e5-8ed3-e0146a080452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62ac57e-5e63-42e5-8ed3-e0146a080452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609e9791-9f69-4f8c-a07c-a171cff8dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Volume 9586708d-55a9-4410-823a-2a01b214dc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9586708d-55a9-4410-823a-2a01b214dc35', 'volume_size': 1}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521246403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9586708d-55a9-4410-823a-2a01b214dc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:35Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Creating volume 9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:35 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:35 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 1073741824
Nov 05 12:14:35 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-d520497c-98d8-44d5-af79-6ed22a8019a6-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-d520497c-98d8-44d5-af79-6ed22a8019a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-6f1245f9-59d7-4002-a272-3256080a8d4c" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-6f1245f9-59d7-4002-a272-3256080a8d4c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-d520497c-98d8-44d5-af79-6ed22a8019a6" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-d520497c-98d8-44d5-af79-6ed22a8019a6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot d520497c-98d8-44d5-af79-6ed22a8019a6 of volume 6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9880347a-8a50-4701-9342-7153d0e87b5c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:35 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6
Nov 05 12:14:35 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:35 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 1073741824" returned: 0 in 0.598s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:35 devstack sudo[108664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35
Nov 05 12:14:35 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6" returned: 0 in 0.526s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f1245f9-59d7-4002-a272-3256080a8d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[733619f8-68d6-4e6a-9371-1a081dcdfaec]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:36 devstack sudo[108670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c
Nov 05 12:14:36 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35" returned: 0 in 0.308s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609e9791-9f69-4f8c-a07c-a171cff8dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9586708d-55a9-4410-823a-2a01b214dc35', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41010dc-0de7-483f-844b-63824cb420e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Volume volume-9586708d-55a9-4410-823a-2a01b214dc35 (9586708d-55a9-4410-823a-2a01b214dc35): created successfully
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41010dc-0de7-483f-844b-63824cb420e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (c884611a-202b-46bd-a4ef-07aa70449503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cbd14e94-5608-4518-884d-4464a4732e2c tempest-ProjectReaderTests-599163803 None] Created volume successfully.
Nov 05 12:14:36 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c" returned: 0 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:36 devstack sudo[108676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6
Nov 05 12:14:36 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6" returned: 0 in 0.339s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:36 devstack sudo[108681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6
Nov 05 12:14:36 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:37 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c.d520497c-98d8-44d5-af79-6ed22a8019a6" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-d520497c-98d8-44d5-af79-6ed22a8019a6" released by "_delete_snapshot" :: held 1.656s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-6f1245f9-59d7-4002-a272-3256080a8d4c" released by "delete_snapshot" :: held 1.683s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Created reservations ['f3db5ae3-17fe-4f55-824b-aa3135a87be6', '0d20c9c5-2e35-447c-aa57-2068637338d8', '864d10a2-7863-41b5-bb2f-d7d623339d5b', '062355bb-6991-4368-859c-ac014ae09208'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-75e6ac96-0c44-4016-91e8-2e23cb18a427 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-d520497c-98d8-44d5-af79-6ed22a8019a6-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Creating offline snapshot 8a85748e-30c0-4e01-a695-294e114a52b2 of volume 9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[525b5a6e-2439-4ae8-8c3d-ad32a4eacde5]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:37 devstack sudo[108684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35
Nov 05 12:14:37 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-6f1245f9-59d7-4002-a272-3256080a8d4c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-6f1245f9-59d7-4002-a272-3256080a8d4c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-6f1245f9-59d7-4002-a272-3256080a8d4c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-6f1245f9-59d7-4002-a272-3256080a8d4c" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fd8238-1248-4d34-9b29-42b5299d151f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:37 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:37 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 1G
Nov 05 12:14:37 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:37 devstack sudo[108686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c
Nov 05 12:14:37 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:38 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:38 devstack sudo[108699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c
Nov 05 12:14:38 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:38 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 1G" returned: 0 in 0.467s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9586708d-55a9-4410-823a-2a01b214dc35 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:38 devstack sudo[108701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9586708d-55a9-4410-823a-2a01b214dc35 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2
Nov 05 12:14:38 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:38 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-6f1245f9-59d7-4002-a272-3256080a8d4c" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-6f1245f9-59d7-4002-a272-3256080a8d4c" released by "delete_volume" :: held 0.760s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Created reservations ['f02a95c0-cc43-4e96-b288-ed7bab15ca20', '21dc0010-07a0-4371-a5c0-7a4ac498d9cf', '5516d735-3072-406e-b061-4e072035d30d', '847b5778-c812-4c5a-8e5c-924a844e7e8a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:38 devstack sudo[108707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:38 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:38 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9586708d-55a9-4410-823a-2a01b214dc35 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:38 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 is being set with open permissions: ugo+rw
Nov 05 12:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:38 devstack sudo[108710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2
Nov 05 12:14:38 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:39 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.307s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ccf3dfa4-aa1a-49f5-b8e1-b6e31b9c39f3 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-6f1245f9-59d7-4002-a272-3256080a8d4c-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:39 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:39 devstack sudo[108714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.info
Nov 05 12:14:39 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:39 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.info" returned: 0 in 0.271s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:39 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.info is being set with open permissions: ugo+rw
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:39 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.info
Nov 05 12:14:39 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (5ab30ba1-7949-439b-9df8-17dfd6962894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406ccc55-0a16-4483-891b-cf96c1b19067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406ccc55-0a16-4483-891b-cf96c1b19067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674431244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b82f79-96ce-4793-a669-e5c792f48788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b90a5a-ee95-4dbd-b570-5697c7750e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b90a5a-ee95-4dbd-b570-5697c7750e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405c01bc-ac53-44aa-92e7-54661c99d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405c01bc-ac53-44aa-92e7-54661c99d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b82f79-96ce-4793-a669-e5c792f48788', 'volume_name': 'volume-81b82f79-96ce-4793-a669-e5c792f48788', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af169e2-4c7f-4215-8bf5-b5abc015aa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af169e2-4c7f-4215-8bf5-b5abc015aa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfe9e4e-41d0-40fa-a38d-3136175ecc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Volume 81b82f79-96ce-4793-a669-e5c792f48788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b82f79-96ce-4793-a669-e5c792f48788', 'volume_size': 1}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:39 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.info" returned: 0 in 0.243s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.154s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674431244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b82f79-96ce-4793-a669-e5c792f48788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Creating volume 81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:39 devstack sudo[108720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 1073741824
Nov 05 12:14:39 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-65d93f16-26fa-468a-b5ab-053ecc73b692 tempest-ProjectReaderTests-599163803 None] Create snapshot completed successfully
Nov 05 12:14:40 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 1073741824" returned: 0 in 0.446s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:40 devstack sudo[108726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788
Nov 05 12:14:40 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:40 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfe9e4e-41d0-40fa-a38d-3136175ecc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b82f79-96ce-4793-a669-e5c792f48788', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178836ad-1c9f-47f3-9e4b-e033619605b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Volume volume-81b82f79-96ce-4793-a669-e5c792f48788 (81b82f79-96ce-4793-a669-e5c792f48788): created successfully
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178836ad-1c9f-47f3-9e4b-e033619605b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (5ab30ba1-7949-439b-9df8-17dfd6962894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6cd2978-d5e0-4316-ba5a-1a351a395a36 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-8a85748e-30c0-4e01-a695-294e114a52b2-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Lock "cinder-8a85748e-30c0-4e01-a695-294e114a52b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-9586708d-55a9-4410-823a-2a01b214dc35" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-9586708d-55a9-4410-823a-2a01b214dc35" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-8a85748e-30c0-4e01-a695-294e114a52b2" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-8a85748e-30c0-4e01-a695-294e114a52b2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Deleting offline snapshot 8a85748e-30c0-4e01-a695-294e114a52b2 of volume 9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] snapshot_file for this snap is: volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc37ffe-f8ef-4945-9f5d-9df3cfbf32e7]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:40 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2
Nov 05 12:14:40 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:41 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9586708d-55a9-4410-823a-2a01b214dc35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:41 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[424dd604-615b-4aec-8faf-03fade26add4]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:41 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35
Nov 05 12:14:41 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:41 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:41 devstack sudo[108739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2
Nov 05 12:14:41 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:42 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot 6be55a05-94ce-4c05-a6a2-0efa63da247c of volume 81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3784ed-ecd1-4e2d-a53a-7dc2f5effcf3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack sudo[108748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2
Nov 05 12:14:42 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack sudo[108749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788
Nov 05 12:14:42 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35.8a85748e-30c0-4e01-a695-294e114a52b2" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-8a85748e-30c0-4e01-a695-294e114a52b2" released by "_delete_snapshot" :: held 1.659s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-9586708d-55a9-4410-823a-2a01b214dc35" released by "delete_snapshot" :: held 1.683s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Created reservations ['b4cc2ee0-1229-4cd6-9698-f71c5314e448', '500fe5d6-e096-431a-a4d6-8f4ded6c77dc', 'c873a064-1062-4ff5-967e-14af85f389fb', 'acbcf613-abb6-4a25-847f-80c844906b0a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:42 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack sudo[108759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c 1G
Nov 05 12:14:42 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Delete snapshot completed successfully.
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-855c5e1e-390f-49a0-899d-be9d3b0e3641 tempest-ProjectReaderTests-599163803 None] Lock "cinder-8a85748e-30c0-4e01-a695-294e114a52b2-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-9586708d-55a9-4410-823a-2a01b214dc35-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Lock "cinder-9586708d-55a9-4410-823a-2a01b214dc35-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-9586708d-55a9-4410-823a-2a01b214dc35" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-9586708d-55a9-4410-823a-2a01b214dc35" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:42 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c 1G" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b82f79-96ce-4793-a669-e5c792f48788 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978be20-fcc1-41cf-97a7-7a5e7f2b0910]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[108765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b82f79-96ce-4793-a669-e5c792f48788 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c
Nov 05 12:14:43 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35
Nov 05 12:14:43 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b82f79-96ce-4793-a669-e5c792f48788 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c is being set with open permissions: ugo+rw
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[108772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c
Nov 05 12:14:43 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[108777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35
Nov 05 12:14:43 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[108780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.info
Nov 05 12:14:43 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-9586708d-55a9-4410-823a-2a01b214dc35" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-9586708d-55a9-4410-823a-2a01b214dc35" released by "delete_volume" :: held 0.826s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Created reservations ['2c8ee547-dda9-48b6-b7fa-fdaa04e82190', 'aa70f532-0bfc-493e-8ee6-9b8b9911a51b', 'bc7c11bf-0886-4dac-8d16-38a47a4b5f59', '28ee754b-f479-4390-9fff-a9d11b6bf35c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:43 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.info" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.info is being set with open permissions: ugo+rw
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[108784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.info
Nov 05 12:14:43 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[108786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:43 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:44 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.info" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Deleted volume successfully.
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1c8a6598-abb7-44e5-aa32-11bc8fc075da tempest-ProjectReaderTests-599163803 None] Lock "cinder-9586708d-55a9-4410-823a-2a01b214dc35-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9f993e00-3128-4e34-b760-54499121d70a tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (29fdc17a-a04d-493b-a75e-9b523a17d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620f793d-d5ed-46b6-b504-42d60d7c1a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620f793d-d5ed-46b6-b504-42d60d7c1a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384424444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8098bbe-aef3-4c6f-b961-0b49772e3107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:44Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a50d88f-f1b8-4189-9f5a-f6a5d9632e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a50d88f-f1b8-4189-9f5a-f6a5d9632e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c470958b-1a7a-4984-8db2-0c5daf42957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c470958b-1a7a-4984-8db2-0c5daf42957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8098bbe-aef3-4c6f-b961-0b49772e3107', 'volume_name': 'volume-c8098bbe-aef3-4c6f-b961-0b49772e3107', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5ea8c-e075-4e40-baf7-87407f8ab90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5ea8c-e075-4e40-baf7-87407f8ab90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c459866e-429c-4b92-b6ec-1eb93b3a0e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Volume c8098bbe-aef3-4c6f-b961-0b49772e3107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8098bbe-aef3-4c6f-b961-0b49772e3107', 'volume_size': 1}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384424444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8098bbe-aef3-4c6f-b961-0b49772e3107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:44Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Creating volume c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:44 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:44 devstack sudo[108791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 1073741824
Nov 05 12:14:44 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 1073741824" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack sudo[108796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107
Nov 05 12:14:45 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-6be55a05-94ce-4c05-a6a2-0efa63da247c-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Lock "cinder-6be55a05-94ce-4c05-a6a2-0efa63da247c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-81b82f79-96ce-4793-a669-e5c792f48788" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-81b82f79-96ce-4793-a669-e5c792f48788" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-6be55a05-94ce-4c05-a6a2-0efa63da247c" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:45 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:45 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-6be55a05-94ce-4c05-a6a2-0efa63da247c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot 6be55a05-94ce-4c05-a6a2-0efa63da247c of volume 81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c96a5a-d01b-41ba-a84c-4d77f343bf58]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c459866e-429c-4b92-b6ec-1eb93b3a0e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8098bbe-aef3-4c6f-b961-0b49772e3107', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a349bd3a-8244-49d4-89be-5d4375196220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Volume volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 (c8098bbe-aef3-4c6f-b961-0b49772e3107): created successfully
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a349bd3a-8244-49d4-89be-5d4375196220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (29fdc17a-a04d-493b-a75e-9b523a17d04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c4dd0d64-e044-441c-9968-90e25691ea06 tempest-ProjectReaderTests-599163803 None] Created volume successfully.
Nov 05 12:14:45 devstack sudo[108801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c
Nov 05 12:14:45 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:14:45 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b82f79-96ce-4793-a669-e5c792f48788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66059b1-8320-4ac6-87be-0aefb265cc79]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack sudo[108807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788
Nov 05 12:14:45 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack sudo[108812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c
Nov 05 12:14:46 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack sudo[108818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c
Nov 05 12:14:46 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Creating offline snapshot eadb294b-bed9-4356-b268-ca2829f01f01 of volume c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba225c8-5f75-4d76-a16b-d89b36b1d00c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788.6be55a05-94ce-4c05-a6a2-0efa63da247c" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-6be55a05-94ce-4c05-a6a2-0efa63da247c" released by "_delete_snapshot" :: held 1.623s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-81b82f79-96ce-4793-a669-e5c792f48788" released by "delete_snapshot" :: held 1.657s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:46 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107
Nov 05 12:14:46 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Created reservations ['772da4e2-5023-4d26-91d0-f8274e15330a', '22bee53f-79be-4d6c-a6ec-7417b628dd8a', '91f86227-96b4-47c4-b795-11568376b691', 'a96d64b6-2bad-4b3e-b62f-1d6083107baf'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6f97b92-9032-4d3a-afcc-63e06ab9a9ec tempest-ProjectMemberTests-1471482416 None] Lock "cinder-6be55a05-94ce-4c05-a6a2-0efa63da247c-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:47 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[108826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 1G
Nov 05 12:14:47 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-81b82f79-96ce-4793-a669-e5c792f48788-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-81b82f79-96ce-4793-a669-e5c792f48788-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-81b82f79-96ce-4793-a669-e5c792f48788" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-81b82f79-96ce-4793-a669-e5c792f48788" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[146aa545-6df7-4bc0-970b-b7db204678ab]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[108830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788
Nov 05 12:14:47 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 1G" returned: 0 in 0.470s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[108834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01
Nov 05 12:14:47 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[108839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788
Nov 05 12:14:47 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 is being set with open permissions: ugo+rw
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack sudo[108844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01
Nov 05 12:14:48 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-81b82f79-96ce-4793-a669-e5c792f48788" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-81b82f79-96ce-4793-a669-e5c792f48788" released by "delete_volume" :: held 0.761s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Created reservations ['ad97d3d3-93af-4ba7-8e6a-36388ba80afe', 'c2580fd1-fcb3-4186-848f-f23c858100c6', '35c74329-3fe0-4fa3-8c14-d520cfd5af27', 'c227270d-6ea6-4f0f-b938-429def87061c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:48 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack sudo[108848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:48 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.info
Nov 05 12:14:48 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:14:48 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.info" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.info is being set with open permissions: ugo+rw
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack sudo[108854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.info
Nov 05 12:14:48 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bc09b399-af8c-4454-ad61-b7fd62c343f8 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-81b82f79-96ce-4793-a669-e5c792f48788-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:48 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.info" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4db92a78-c3a7-4389-9c2d-cc392c18fbb3 tempest-ProjectReaderTests-599163803 None] Create snapshot completed successfully
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (565bdb0b-770d-4277-9eb2-42c156d8aadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af4b7c9-62bf-4eaf-a502-7ded3414a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af4b7c9-62bf-4eaf-a502-7ded3414a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375675832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0818030d-0fd6-424f-bb21-6dbd7395a6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:49Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b1135-bd31-48c8-be9e-c593712f45e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b1135-bd31-48c8-be9e-c593712f45e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c79be74-d081-413a-a826-8085cc4bc69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c79be74-d081-413a-a826-8085cc4bc69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0818030d-0fd6-424f-bb21-6dbd7395a6f9', 'volume_name': 'volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f25373-b175-4777-b01f-a2d8592b16e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f25373-b175-4777-b01f-a2d8592b16e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c058e9b0-a88b-4683-936e-ea716756e20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Volume 0818030d-0fd6-424f-bb21-6dbd7395a6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9', 'volume_size': 1}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375675832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0818030d-0fd6-424f-bb21-6dbd7395a6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:49Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Creating volume 0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:49 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:49 devstack sudo[108857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 1073741824
Nov 05 12:14:49 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:49 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 1073741824" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:49 devstack sudo[108862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9
Nov 05 12:14:49 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:49 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c058e9b0-a88b-4683-936e-ea716756e20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fc23bb-fe98-4988-8e56-077efd16a58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Volume volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 (0818030d-0fd6-424f-bb21-6dbd7395a6f9): created successfully
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fc23bb-fe98-4988-8e56-077efd16a58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (565bdb0b-770d-4277-9eb2-42c156d8aadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a4ea6055-d1c2-4f6c-a75b-49dfa6b0c9d6 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-eadb294b-bed9-4356-b268-ca2829f01f01-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Lock "cinder-eadb294b-bed9-4356-b268-ca2829f01f01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-c8098bbe-aef3-4c6f-b961-0b49772e3107" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-c8098bbe-aef3-4c6f-b961-0b49772e3107" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-eadb294b-bed9-4356-b268-ca2829f01f01" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-eadb294b-bed9-4356-b268-ca2829f01f01" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Deleting offline snapshot eadb294b-bed9-4356-b268-ca2829f01f01 of volume c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] snapshot_file for this snap is: volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62007a2c-ad95-435e-81e3-fc5b00ec0606]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01
Nov 05 12:14:50 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot 178047d9-e0bf-428a-8d5a-dd9af062fd77 of volume 0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[59772898-987f-4591-9521-ec7640e5762f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[108867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9
Nov 05 12:14:50 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01" returned: 0 in 0.422s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8098bbe-aef3-4c6f-b961-0b49772e3107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b19f6f-17a6-4dcf-b4c5-8848c671e0cc]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[108872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107
Nov 05 12:14:50 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9" returned: 0 in 0.409s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 1G
Nov 05 12:14:50 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[108884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01
Nov 05 12:14:51 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:51 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 1G" returned: 0 in 0.459s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[108888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77
Nov 05 12:14:51 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:51 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[108893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01
Nov 05 12:14:51 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:51 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 is being set with open permissions: ugo+rw
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[108898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77
Nov 05 12:14:51 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:51 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107.eadb294b-bed9-4356-b268-ca2829f01f01" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-eadb294b-bed9-4356-b268-ca2829f01f01" released by "_delete_snapshot" :: held 1.578s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-c8098bbe-aef3-4c6f-b961-0b49772e3107" released by "delete_snapshot" :: held 1.606s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Created reservations ['76ed3ebe-ebde-49a9-9f37-faeadca2c8b7', 'ae3e2282-bbbd-4d6e-acec-56a47a0c77fc', '6279dccb-841c-4ed8-be7c-dae3eb16826a', '26d727b8-829e-481b-a171-99bf67cdd99c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Delete snapshot completed successfully.
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d15ba240-ce29-40e8-b4bc-af8a64658a54 tempest-ProjectReaderTests-599163803 None] Lock "cinder-eadb294b-bed9-4356-b268-ca2829f01f01-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:51 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[108902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.info
Nov 05 12:14:51 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.info" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:52 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.info is being set with open permissions: ugo+rw
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:52 devstack sudo[108905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.info
Nov 05 12:14:52 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-c8098bbe-aef3-4c6f-b961-0b49772e3107-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Lock "cinder-c8098bbe-aef3-4c6f-b961-0b49772e3107-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-c8098bbe-aef3-4c6f-b961-0b49772e3107" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-c8098bbe-aef3-4c6f-b961-0b49772e3107" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b4d4c-e69f-4376-ab36-1dc49c2c32b0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:52 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.info" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ed268996-24aa-453a-a4d0-b04033294dc9 tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:14:52 devstack sudo[108908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107
Nov 05 12:14:52 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107" returned: 0 in 0.376s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:52 devstack sudo[108914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107
Nov 05 12:14:52 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-c8098bbe-aef3-4c6f-b961-0b49772e3107" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-c8098bbe-aef3-4c6f-b961-0b49772e3107" released by "delete_volume" :: held 0.700s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Created reservations ['38d261c7-b679-4512-b213-408b22730343', '0a8747e0-1480-4e39-ba16-54498df309f9', 'f7009530-360c-4fe8-81b8-4241688b2ef3', '24ac2ae5-f676-4f20-b816-05cf5ed23815'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:53 devstack sudo[108918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:53 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:53 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Deleted volume successfully.
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ad8d4b5c-25f9-4967-aa8a-b5203e4b8c9b tempest-ProjectReaderTests-599163803 None] Lock "cinder-c8098bbe-aef3-4c6f-b961-0b49772e3107-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-178047d9-e0bf-428a-8d5a-dd9af062fd77-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Lock "cinder-178047d9-e0bf-428a-8d5a-dd9af062fd77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-0818030d-0fd6-424f-bb21-6dbd7395a6f9" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-0818030d-0fd6-424f-bb21-6dbd7395a6f9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-178047d9-e0bf-428a-8d5a-dd9af062fd77" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-178047d9-e0bf-428a-8d5a-dd9af062fd77" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot 178047d9-e0bf-428a-8d5a-dd9af062fd77 of volume 0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b370311-0cee-4db1-9135-c9e7f3b217fa]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:53 devstack sudo[108921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77
Nov 05 12:14:53 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:54 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (21cdf1a2-8078-4dc7-870f-af240d5ba546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd764ff-d59e-4d12-a170-31ad2fef9f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77" returned: 0 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd764ff-d59e-4d12-a170-31ad2fef9f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920008078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474d59bf-0eae-4b09-abda-d28408682899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:54Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fc83d8-77ab-4970-970f-dc8bdac5c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fc83d8-77ab-4970-970f-dc8bdac5c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afe4dbb-0c52-4ee4-bff7-0cd0c467acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afe4dbb-0c52-4ee4-bff7-0cd0c467acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474d59bf-0eae-4b09-abda-d28408682899', 'volume_name': 'volume-474d59bf-0eae-4b09-abda-d28408682899', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bede7e79-ab31-49ac-bd69-cb6297af6f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bede7e79-ab31-49ac-bd69-cb6297af6f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d36a15-7f3e-4f91-96e9-af86058880be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Volume 474d59bf-0eae-4b09-abda-d28408682899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474d59bf-0eae-4b09-abda-d28408682899', 'volume_size': 1}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920008078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474d59bf-0eae-4b09-abda-d28408682899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:54Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Creating volume 474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea61544-f87a-423e-b481-bb41c7cb3649]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:54 devstack sudo[108926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 1073741824
Nov 05 12:14:54 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:54 devstack sudo[108927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9
Nov 05 12:14:54 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:54 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:54 devstack sudo[108938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77
Nov 05 12:14:54 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:54 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 1073741824" returned: 0 in 0.470s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:54 devstack sudo[108940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899
Nov 05 12:14:54 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:54 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:54 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:54 devstack sudo[108946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77
Nov 05 12:14:54 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d36a15-7f3e-4f91-96e9-af86058880be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474d59bf-0eae-4b09-abda-d28408682899', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0a80f9-07a1-4620-a680-8747d50eebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Volume volume-474d59bf-0eae-4b09-abda-d28408682899 (474d59bf-0eae-4b09-abda-d28408682899): created successfully
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0a80f9-07a1-4620-a680-8747d50eebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (21cdf1a2-8078-4dc7-870f-af240d5ba546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6605d6e6-8b75-47e3-bd5f-0cfd5dc14538 tempest-ProjectReaderTests-599163803 None] Created volume successfully.
Nov 05 12:14:55 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9.178047d9-e0bf-428a-8d5a-dd9af062fd77" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-178047d9-e0bf-428a-8d5a-dd9af062fd77" released by "_delete_snapshot" :: held 1.650s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-0818030d-0fd6-424f-bb21-6dbd7395a6f9" released by "delete_snapshot" :: held 1.672s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Created reservations ['bc4748b9-4c83-4930-975a-3353881aa3be', '6800ed9d-f6dc-492b-a96a-b0ed20078d6c', 'a642eccc-c2cb-4742-952f-60599622c589', '67d95294-fd80-4419-8d42-aa0d13987d6c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4652ce74-d818-46b0-bfa7-9210028c95fd tempest-ProjectMemberTests-1471482416 None] Lock "cinder-178047d9-e0bf-428a-8d5a-dd9af062fd77-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-0818030d-0fd6-424f-bb21-6dbd7395a6f9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Lock "cinder-0818030d-0fd6-424f-bb21-6dbd7395a6f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-0818030d-0fd6-424f-bb21-6dbd7395a6f9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-0818030d-0fd6-424f-bb21-6dbd7395a6f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90da279-5d83-452f-8f3d-e1a005f51f95]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:55 devstack sudo[108949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9
Nov 05 12:14:55 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Creating offline snapshot f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 of volume 474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:56 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99467086-a4c3-4b06-b227-618b906d9ad8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack sudo[108954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9
Nov 05 12:14:56 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack sudo[108955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899
Nov 05 12:14:56 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-0818030d-0fd6-424f-bb21-6dbd7395a6f9" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-0818030d-0fd6-424f-bb21-6dbd7395a6f9" released by "delete_volume" :: held 0.769s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Created reservations ['5bdb3e48-1b8f-4f27-b17a-46d57096e814', '6b9b19df-0c43-4530-9769-12005a1e975b', '4cf344a9-82b1-46c3-a55a-8af413624269', '3806c999-f5cd-4bd6-bf2a-18812b7cca96'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack sudo[108962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:14:56 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 1G
Nov 05 12:14:56 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.305s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:14:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-73fe48be-6cd9-4eba-aa70-ececb3f2887b tempest-ProjectMemberTests-1471482416 None] Lock "cinder-0818030d-0fd6-424f-bb21-6dbd7395a6f9-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:57 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 1G" returned: 0 in 0.535s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-474d59bf-0eae-4b09-abda-d28408682899 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:57 devstack sudo[108970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-474d59bf-0eae-4b09-abda-d28408682899 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3
Nov 05 12:14:57 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (46738a37-293b-4f39-a0ab-2b2b52a78f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce617f57-273b-4186-bf81-9ce87cc66deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce617f57-273b-4186-bf81-9ce87cc66deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887207848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8eab6e1-5d44-4c07-be88-cc191901c515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f436cc-64cc-400c-87d9-e6e5011d939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f436cc-64cc-400c-87d9-e6e5011d939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3425bae0-d8d4-41d7-96ee-13edb09dfa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3425bae0-d8d4-41d7-96ee-13edb09dfa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8eab6e1-5d44-4c07-be88-cc191901c515', 'volume_name': 'volume-e8eab6e1-5d44-4c07-be88-cc191901c515', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2d82f1-6c62-45d9-bec3-404ebd7cc8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2d82f1-6c62-45d9-bec3-404ebd7cc8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b420e73c-343a-4562-bfcd-579659b67e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Volume e8eab6e1-5d44-4c07-be88-cc191901c515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8eab6e1-5d44-4c07-be88-cc191901c515', 'volume_size': 1}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:57 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-474d59bf-0eae-4b09-abda-d28408682899 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 is being set with open permissions: ugo+rw
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:57 devstack sudo[108976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3
Nov 05 12:14:57 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:57 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:57 devstack sudo[108979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.info
Nov 05 12:14:57 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:58 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.info" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:58 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.info is being set with open permissions: ugo+rw
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:58 devstack sudo[108982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.info
Nov 05 12:14:58 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:58 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.info" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887207848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8eab6e1-5d44-4c07-be88-cc191901c515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Creating volume e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:58 devstack sudo[108985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 1073741824
Nov 05 12:14:58 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-51f7180d-789a-486a-912d-4ba252a2c92f tempest-ProjectReaderTests-599163803 None] Create snapshot completed successfully
Nov 05 12:14:58 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 1073741824" returned: 0 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:58 devstack sudo[108991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515
Nov 05 12:14:58 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:59 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b420e73c-343a-4562-bfcd-579659b67e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8eab6e1-5d44-4c07-be88-cc191901c515', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ad199c-e003-461b-a342-0c1d985e14f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Volume volume-e8eab6e1-5d44-4c07-be88-cc191901c515 (e8eab6e1-5d44-4c07-be88-cc191901c515): created successfully
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ad199c-e003-461b-a342-0c1d985e14f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (46738a37-293b-4f39-a0ab-2b2b52a78f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fcf5d57d-1975-456d-a9f3-bb44d88ef697 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-f26b85b0-a3de-4ff9-a1c7-2180fd1045a3-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Lock "cinder-f26b85b0-a3de-4ff9-a1c7-2180fd1045a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-474d59bf-0eae-4b09-abda-d28408682899" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-474d59bf-0eae-4b09-abda-d28408682899" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Deleting offline snapshot f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 of volume 474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] snapshot_file for this snap is: volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4840c3-e7e5-4ece-a0f5-7595733c61e3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:59 devstack sudo[108994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3
Nov 05 12:14:59 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot b229ae4a-95f4-4c3f-b08f-8040ad206b10 of volume e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[88df674b-d011-4a01-80f9-9578626a7db6]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:59 devstack sudo[108996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515
Nov 05 12:14:59 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:59 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" returned: 0 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-474d59bf-0eae-4b09-abda-d28408682899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4529f7-c629-4375-b1af-143c061f589e]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[109001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899
Nov 05 12:15:00 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[109006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 1G
Nov 05 12:15:00 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899" returned: 0 in 0.394s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[109013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3
Nov 05 12:15:00 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 1G" returned: 0 in 0.460s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8eab6e1-5d44-4c07-be88-cc191901c515 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[109017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8eab6e1-5d44-4c07-be88-cc191901c515 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10
Nov 05 12:15:00 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[109022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3
Nov 05 12:15:00 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8eab6e1-5d44-4c07-be88-cc191901c515 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 is being set with open permissions: ugo+rw
Nov 05 12:15:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[109027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10
Nov 05 12:15:00 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:01 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899.f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-f26b85b0-a3de-4ff9-a1c7-2180fd1045a3" released by "_delete_snapshot" :: held 1.639s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-474d59bf-0eae-4b09-abda-d28408682899" released by "delete_snapshot" :: held 1.667s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Created reservations ['c6dccd09-3c24-4fb6-953f-90fdf2007dce', '907bedb2-31c4-42c3-9eaa-c2199a01e64a', 'ffbf523e-8a04-4df8-9457-8ffa6d70c1e2', 'c0a08a66-dd5e-481b-a32b-b93da0216c62'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:01 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:01 devstack sudo[109031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.info
Nov 05 12:15:01 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Delete snapshot completed successfully.
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-13d5d0ec-7b6c-4968-a42b-38ed47e9207b tempest-ProjectReaderTests-599163803 None] Lock "cinder-f26b85b0-a3de-4ff9-a1c7-2180fd1045a3-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:01 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.info" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:01 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.info is being set with open permissions: ugo+rw
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:01 devstack sudo[109037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.info
Nov 05 12:15:01 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-474d59bf-0eae-4b09-abda-d28408682899-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Lock "cinder-474d59bf-0eae-4b09-abda-d28408682899-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-474d59bf-0eae-4b09-abda-d28408682899" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-474d59bf-0eae-4b09-abda-d28408682899" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7392380-6fd6-4137-85d9-eb360c70466b]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:01 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.info" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ba21ed29-2307-44a6-a3e6-14723557adce tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:15:01 devstack sudo[109040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899
Nov 05 12:15:01 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:02 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899" returned: 0 in 0.374s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:02 devstack sudo[109045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899
Nov 05 12:15:02 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:02 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-474d59bf-0eae-4b09-abda-d28408682899" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-474d59bf-0eae-4b09-abda-d28408682899" released by "delete_volume" :: held 0.705s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Created reservations ['fb108611-a5f5-4351-9892-8fb3b3be3645', '7f5aea2c-8a56-4dfd-a1b7-97dbf9d0eb86', 'fe6bc8ba-9e6a-4c74-8c9e-e1b14e1c263f', '55bd6ab3-d890-4e1b-954f-26a34e735a5d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:02 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:02 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:02 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Deleted volume successfully.
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-68daf5d1-4821-498d-a1a4-d86dae92ed76 tempest-ProjectReaderTests-599163803 None] Lock "cinder-474d59bf-0eae-4b09-abda-d28408682899-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-b229ae4a-95f4-4c3f-b08f-8040ad206b10-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Lock "cinder-b229ae4a-95f4-4c3f-b08f-8040ad206b10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-e8eab6e1-5d44-4c07-be88-cc191901c515" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-e8eab6e1-5d44-4c07-be88-cc191901c515" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-b229ae4a-95f4-4c3f-b08f-8040ad206b10" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-b229ae4a-95f4-4c3f-b08f-8040ad206b10" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot b229ae4a-95f4-4c3f-b08f-8040ad206b10 of volume e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0b8134-9b44-4e07-aace-607958f72d54]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack sudo[109051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10
Nov 05 12:15:03 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (a1014afa-5ce3-4072-a0b2-333068bde4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e9fb09-38b4-418e-8902-ea994ad83a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e9fb09-38b4-418e-8902-ea994ad83a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166856096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5570f1-d413-40a3-93cc-ad20298f87a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:03Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f05c78-f36e-4934-96c1-01fd8795ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f05c78-f36e-4934-96c1-01fd8795ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e37d91-0666-44ba-a4be-680a573c3400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e37d91-0666-44ba-a4be-680a573c3400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d5570f1-d413-40a3-93cc-ad20298f87a5', 'volume_name': 'volume-4d5570f1-d413-40a3-93cc-ad20298f87a5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a356104e-33d9-48b6-97a8-8b5dc0abe6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a356104e-33d9-48b6-97a8-8b5dc0abe6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aef939-6c9f-418b-abe7-ab1984a9f63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Volume 4d5570f1-d413-40a3-93cc-ad20298f87a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d5570f1-d413-40a3-93cc-ad20298f87a5', 'volume_size': 1}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166856096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5570f1-d413-40a3-93cc-ad20298f87a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81604268669a4e2ead4e6d90964af548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:03Z,use_quota=True,user_id='14f149685f8144c3b30f0a482e8f3cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Creating volume 4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:03 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:03 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8eab6e1-5d44-4c07-be88-cc191901c515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:03 devstack sudo[109056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 1073741824
Nov 05 12:15:03 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed86630-aa40-4b64-8dc3-5aa79205122c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack sudo[109058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515
Nov 05 12:15:03 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 1073741824" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack sudo[109068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10
Nov 05 12:15:03 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack sudo[109070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5
Nov 05 12:15:03 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:04 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aef939-6c9f-418b-abe7-ab1984a9f63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d5570f1-d413-40a3-93cc-ad20298f87a5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff698b9-2d25-4829-ab46-618e91fb754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Volume volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 (4d5570f1-d413-40a3-93cc-ad20298f87a5): created successfully
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff698b9-2d25-4829-ab46-618e91fb754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Flow 'volume_create_manager' (a1014afa-5ce3-4072-a0b2-333068bde4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:04 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ae47a0c4-8412-41b2-be2e-0132a4b17e0c tempest-ProjectReaderTests-599163803 None] Created volume successfully.
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10" returned: 0 in 0.394s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:04 devstack sudo[109078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10
Nov 05 12:15:04 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:04 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515.b229ae4a-95f4-4c3f-b08f-8040ad206b10" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-b229ae4a-95f4-4c3f-b08f-8040ad206b10" released by "_delete_snapshot" :: held 1.621s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-e8eab6e1-5d44-4c07-be88-cc191901c515" released by "delete_snapshot" :: held 1.646s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Created reservations ['832441ad-1430-42d3-8365-144e9dbe0e8b', 'c4591588-b37e-49f3-a911-6b77f86054c4', 'f47c5a55-141e-4fdd-ade3-0faa2aa4fd7e', '4c718814-4630-4ea9-8757-6980a758e3f0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e78b8b87-2e03-47fd-ba94-0e0ba49db3ea tempest-ProjectMemberTests-1471482416 None] Lock "cinder-b229ae4a-95f4-4c3f-b08f-8040ad206b10-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-e8eab6e1-5d44-4c07-be88-cc191901c515-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-e8eab6e1-5d44-4c07-be88-cc191901c515-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-e8eab6e1-5d44-4c07-be88-cc191901c515" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-e8eab6e1-5d44-4c07-be88-cc191901c515" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8815854c-710f-43f1-885a-2d8323c546a5]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[109081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515
Nov 05 12:15:05 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[109086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515
Nov 05 12:15:05 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Creating offline snapshot d1420ed8-89b7-4f8a-b76b-dedaadc5b21b of volume 4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eae6560-c9c1-4884-944e-8994053856b0]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[109088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5
Nov 05 12:15:05 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-e8eab6e1-5d44-4c07-be88-cc191901c515" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-e8eab6e1-5d44-4c07-be88-cc191901c515" released by "delete_volume" :: held 0.728s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Created reservations ['b0bd8565-1358-470c-9b10-b67f2491a9de', 'b46f5466-54ae-415b-b7f3-867913f41bc7', '0805d11f-6f4c-4c11-bf12-f2356adf380f', 'ace47d60-1e5a-43b8-b5fa-ee869aaedb05'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[109094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:05 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[109096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b 1G
Nov 05 12:15:05 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:06 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-670c8e2a-479d-4af4-8387-66bbf6eef0b4 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-e8eab6e1-5d44-4c07-be88-cc191901c515-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:06 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b 1G" returned: 0 in 0.475s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:06 devstack sudo[109123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b
Nov 05 12:15:06 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (3955dbd7-ebfe-4ebc-9636-874982675be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2e27a6-c748-40a5-9114-65895957176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2e27a6-c748-40a5-9114-65895957176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-265294138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadc0b50-89f1-4a52-bb93-e748d1483466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:07Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371f656b-67b1-433c-9ccd-a5be1d09eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371f656b-67b1-433c-9ccd-a5be1d09eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819404ff-d449-48f5-85d3-d38bf5c5509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819404ff-d449-48f5-85d3-d38bf5c5509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadc0b50-89f1-4a52-bb93-e748d1483466', 'volume_name': 'volume-dadc0b50-89f1-4a52-bb93-e748d1483466', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb110cfb-6365-43bf-93a7-994d398d6067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb110cfb-6365-43bf-93a7-994d398d6067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bfe62d-a225-4eaa-a4f0-8fa380171597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Volume dadc0b50-89f1-4a52-bb93-e748d1483466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadc0b50-89f1-4a52-bb93-e748d1483466', 'volume_size': 1}
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:06 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:06 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b is being set with open permissions: ugo+rw
Nov 05 12:15:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:06 devstack sudo[109144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b
Nov 05 12:15:06 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" returned: 0 in 0.242s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack sudo[109147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.info
Nov 05 12:15:07 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.info" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.info is being set with open permissions: ugo+rw
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack sudo[109150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.info
Nov 05 12:15:07 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.info" returned: 0 in 0.252s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-265294138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadc0b50-89f1-4a52-bb93-e748d1483466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:07Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Creating volume dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack sudo[109153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 1073741824
Nov 05 12:15:07 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2d730a67-73e8-4f04-896b-abc1bb0a4ffd tempest-ProjectReaderTests-599163803 None] Create snapshot completed successfully
Nov 05 12:15:08 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 1073741824" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[109158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466
Nov 05 12:15:08 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bfe62d-a225-4eaa-a4f0-8fa380171597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadc0b50-89f1-4a52-bb93-e748d1483466', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ac708f-3642-474e-a105-d442686fc2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Volume volume-dadc0b50-89f1-4a52-bb93-e748d1483466 (dadc0b50-89f1-4a52-bb93-e748d1483466): created successfully
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ac708f-3642-474e-a105-d442686fc2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (3955dbd7-ebfe-4ebc-9636-874982675be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9b576a0e-216b-413e-8e94-404383f48f38 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-d1420ed8-89b7-4f8a-b76b-dedaadc5b21b-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Lock "cinder-d1420ed8-89b7-4f8a-b76b-dedaadc5b21b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-4d5570f1-d413-40a3-93cc-ad20298f87a5" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-4d5570f1-d413-40a3-93cc-ad20298f87a5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Deleting offline snapshot d1420ed8-89b7-4f8a-b76b-dedaadc5b21b of volume 4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] snapshot_file for this snap is: volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c5d561-df0e-4b47-84e4-821dae2a9536]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[109161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b
Nov 05 12:15:08 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot a30350ba-4424-4ee7-9ac1-a2860870d47f of volume dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a5e658-d2a8-4647-aafa-a21194ad96e8]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:09 devstack sudo[109163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466
Nov 05 12:15:09 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:09 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d5570f1-d413-40a3-93cc-ad20298f87a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae996242-41cf-4bfe-90c0-d4b53f5d0515]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:09 devstack sudo[109168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5
Nov 05 12:15:09 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:09 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:09 devstack sudo[109173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f 1G
Nov 05 12:15:09 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:09 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:09 devstack sudo[109178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b
Nov 05 12:15:09 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:09 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f 1G" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dadc0b50-89f1-4a52-bb93-e748d1483466 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:09 devstack sudo[109186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dadc0b50-89f1-4a52-bb93-e748d1483466 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f
Nov 05 12:15:09 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:10 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:10 devstack sudo[109189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b
Nov 05 12:15:10 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:10 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dadc0b50-89f1-4a52-bb93-e748d1483466 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:10 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f is being set with open permissions: ugo+rw
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:10 devstack sudo[109194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f
Nov 05 12:15:10 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:10 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5.d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-d1420ed8-89b7-4f8a-b76b-dedaadc5b21b" released by "_delete_snapshot" :: held 1.577s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-4d5570f1-d413-40a3-93cc-ad20298f87a5" released by "delete_snapshot" :: held 1.618s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Created reservations ['002b168d-e202-43af-ad22-e0c0f2185223', 'fefdeb4b-e970-421d-b008-445ce9f1c269', 'b551e885-e5a9-453c-adcb-8addf87b6a17', '76563c8b-e6c7-4cb9-b369-9988be8a4002'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Delete snapshot completed successfully.
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3601adca-1733-4003-957b-9dfdc1448d5a tempest-ProjectReaderTests-599163803 None] Lock "cinder-d1420ed8-89b7-4f8a-b76b-dedaadc5b21b-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:10 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:10 devstack sudo[109198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.info
Nov 05 12:15:10 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:10 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.info" returned: 0 in 0.242s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:10 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.info is being set with open permissions: ugo+rw
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:10 devstack sudo[109201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.info
Nov 05 12:15:10 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-4d5570f1-d413-40a3-93cc-ad20298f87a5-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Lock "cinder-4d5570f1-d413-40a3-93cc-ad20298f87a5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Acquiring lock "cinder-quobyte-4d5570f1-d413-40a3-93cc-ad20298f87a5" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-4d5570f1-d413-40a3-93cc-ad20298f87a5" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00810e72-fda5-4125-b743-a46856f84a0d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:11 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.info" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6d8b8812-28ed-4550-b39f-8a1fdc26ec34 tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:15:11 devstack sudo[109204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5
Nov 05 12:15:11 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:11 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:11 devstack sudo[109209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5
Nov 05 12:15:11 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:11 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-4d5570f1-d413-40a3-93cc-ad20298f87a5" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Lock "cinder-quobyte-4d5570f1-d413-40a3-93cc-ad20298f87a5" released by "delete_volume" :: held 0.724s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Created reservations ['cdf6b853-4c45-48f9-82a6-02efff6315ac', '33164c37-d969-45cc-80e9-2e536269188a', '9032ec6e-e578-4621-be46-b83a666bcc9c', 'a8c68924-e518-4c66-8e79-1161c7d4f589'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:11 devstack sudo[109212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:11 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:12 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Deleted volume successfully.
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-019d94a3-4f4b-4728-a8e1-ce6616a44d16 tempest-ProjectReaderTests-599163803 None] Lock "cinder-4d5570f1-d413-40a3-93cc-ad20298f87a5-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-a30350ba-4424-4ee7-9ac1-a2860870d47f-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-a30350ba-4424-4ee7-9ac1-a2860870d47f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-dadc0b50-89f1-4a52-bb93-e748d1483466" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-dadc0b50-89f1-4a52-bb93-e748d1483466" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-a30350ba-4424-4ee7-9ac1-a2860870d47f" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-a30350ba-4424-4ee7-9ac1-a2860870d47f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot a30350ba-4424-4ee7-9ac1-a2860870d47f of volume dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c2e48-02d4-4d08-8621-a8e99bc73de3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:12 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f
Nov 05 12:15:12 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:12 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dadc0b50-89f1-4a52-bb93-e748d1483466(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a04e9-68a5-4196-88cd-24a1af021af3]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:12 devstack sudo[109220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466
Nov 05 12:15:12 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:13 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:13 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f
Nov 05 12:15:13 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:13 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:13 devstack sudo[109231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f
Nov 05 12:15:13 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:13 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466.a30350ba-4424-4ee7-9ac1-a2860870d47f" returned: 0 in 0.282s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-a30350ba-4424-4ee7-9ac1-a2860870d47f" released by "_delete_snapshot" :: held 1.603s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-dadc0b50-89f1-4a52-bb93-e748d1483466" released by "delete_snapshot" :: held 1.630s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Created reservations ['5d1df836-879c-4dde-9d2f-c275659ab554', 'd436f2ca-471a-4d5b-9d54-606287328ef8', '456d8847-04c3-47a5-bc19-4de6f0fa2e3a', '71440bda-b5dc-49a3-8f11-2795b28ff874'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f05d13da-4eca-4a73-b0e9-496467528cb2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-a30350ba-4424-4ee7-9ac1-a2860870d47f-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-dadc0b50-89f1-4a52-bb93-e748d1483466-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-dadc0b50-89f1-4a52-bb93-e748d1483466-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-dadc0b50-89f1-4a52-bb93-e748d1483466" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-dadc0b50-89f1-4a52-bb93-e748d1483466" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb36710f-62ac-41d7-b491-d1f1345c7960]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:14 devstack sudo[109235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466
Nov 05 12:15:14 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:14 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466" returned: 0 in 0.374s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:14 devstack sudo[109240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466
Nov 05 12:15:14 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:15 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-dadc0b50-89f1-4a52-bb93-e748d1483466" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-dadc0b50-89f1-4a52-bb93-e748d1483466" released by "delete_volume" :: held 0.717s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Created reservations ['8b8b8d02-33b1-4c7f-8d57-a0225dc96728', '74f84a17-1e09-4acd-807f-081b0d6e3f2f', '64c616fd-c9ee-4742-9354-1e070b11fd97', '9a00293a-e474-412e-9773-f7f258ff8b66'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:15 devstack sudo[109243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:15 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:15 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:15:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-59e89501-0e0c-436f-9aa3-8a83be5c19a2 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-dadc0b50-89f1-4a52-bb93-e748d1483466-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (8a499939-19d0-4a9f-8afd-e992661549c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337c2b90-4016-49fd-b517-b94394b3285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337c2b90-4016-49fd-b517-b94394b3285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678704447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96a3315-7fdb-4f03-be71-fa3fb64921a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:16Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8f3980-5a32-469c-8b60-bca380dd4db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8f3980-5a32-469c-8b60-bca380dd4db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab4cad7-6ba8-47db-a8f1-cc002c81c2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab4cad7-6ba8-47db-a8f1-cc002c81c2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96a3315-7fdb-4f03-be71-fa3fb64921a2', 'volume_name': 'volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9715b6b-26ef-4b30-a3e8-2042b6691525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9715b6b-26ef-4b30-a3e8-2042b6691525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef6d3ee-2627-4ffb-affb-dee4134ba61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Volume f96a3315-7fdb-4f03-be71-fa3fb64921a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2', 'volume_size': 1}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678704447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96a3315-7fdb-4f03-be71-fa3fb64921a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:16Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Creating volume f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:16 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:16 devstack sudo[109246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 1073741824
Nov 05 12:15:16 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:16 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 1073741824" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:16 devstack sudo[109252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2
Nov 05 12:15:16 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:16 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef6d3ee-2627-4ffb-affb-dee4134ba61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9af99f9-709e-49da-9bb1-85ee40bd2614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:16 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=182,cinder:UPDATE=237,cinder:INSERT=64,cinder:DELETE=22 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:15:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Volume volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 (f96a3315-7fdb-4f03-be71-fa3fb64921a2): created successfully
Nov 05 12:15:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9af99f9-709e-49da-9bb1-85ee40bd2614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (8a499939-19d0-4a9f-8afd-e992661549c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a7432b8d-63a4-499c-b879-f7c16432094f tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=194,cinder:INSERT=69,cinder:UPDATE=247,cinder:DELETE=18 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot 9a37a54f-8795-4424-84bc-5d4f227a56b0 of volume f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69fed94-0325-4aab-9692-18a246fc405d]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:18 devstack sudo[109255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2
Nov 05 12:15:18 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:18 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:18 devstack sudo[109260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 1G
Nov 05 12:15:18 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:19 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 1G" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:19 devstack sudo[109266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0
Nov 05 12:15:19 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:19 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0" returned: 0 in 0.351s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:19 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 is being set with open permissions: ugo+rw
Nov 05 12:15:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:19 devstack sudo[109271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0
Nov 05 12:15:19 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:19 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0" returned: 0 in 0.385s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[109274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.info
Nov 05 12:15:20 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.info" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.info is being set with open permissions: ugo+rw
Nov 05 12:15:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[109277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.info
Nov 05 12:15:20 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.info" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fa9e326d-2826-4bd5-8d4f-d36c8028abde tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-9a37a54f-8795-4424-84bc-5d4f227a56b0-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-9a37a54f-8795-4424-84bc-5d4f227a56b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-f96a3315-7fdb-4f03-be71-fa3fb64921a2" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-f96a3315-7fdb-4f03-be71-fa3fb64921a2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-9a37a54f-8795-4424-84bc-5d4f227a56b0" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-9a37a54f-8795-4424-84bc-5d4f227a56b0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot 9a37a54f-8795-4424-84bc-5d4f227a56b0 of volume f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c779c709-39c0-404e-9a92-b840e6cce691]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:21 devstack sudo[109280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0
Nov 05 12:15:21 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:21 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0" returned: 0 in 0.385s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8bf8cd-75b1-4568-8184-3133311b2168]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[109286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2
Nov 05 12:15:22 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[109291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0
Nov 05 12:15:22 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0" returned: 0 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[109296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0
Nov 05 12:15:22 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:23 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2.9a37a54f-8795-4424-84bc-5d4f227a56b0" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-9a37a54f-8795-4424-84bc-5d4f227a56b0" released by "_delete_snapshot" :: held 1.580s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-f96a3315-7fdb-4f03-be71-fa3fb64921a2" released by "delete_snapshot" :: held 1.607s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Created reservations ['fe2f1a77-2c0f-48be-a839-ab996ce7a7ee', '8097cbb5-07b8-48e6-a60c-3f7735abb832', '1fe6d5c6-38f7-41cd-a59c-4d5f80685604', '07e41a14-6fe1-4eb7-be59-9b74259badf3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-10a58113-76e3-4ac1-9942-9bb2ad025a27 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-9a37a54f-8795-4424-84bc-5d4f227a56b0-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-f96a3315-7fdb-4f03-be71-fa3fb64921a2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-f96a3315-7fdb-4f03-be71-fa3fb64921a2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-f96a3315-7fdb-4f03-be71-fa3fb64921a2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-f96a3315-7fdb-4f03-be71-fa3fb64921a2" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e2d53d-5a17-480f-a5bd-ec0d9c01af0c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:23 devstack sudo[109299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2
Nov 05 12:15:23 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:24 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:24 devstack sudo[109305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2
Nov 05 12:15:24 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:24 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-f96a3315-7fdb-4f03-be71-fa3fb64921a2" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-f96a3315-7fdb-4f03-be71-fa3fb64921a2" released by "delete_volume" :: held 0.782s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Created reservations ['a6c1ea9d-1edf-4aab-8f18-ccbdf80b90cd', '381dc677-b413-4b08-b752-c014119d7495', '618df04f-14a2-42ae-b359-9e805549ffb5', 'cff1bbd3-d532-4e8a-8edb-883fbb52287c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:24 devstack sudo[109308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:24 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d7a073b-7a9e-4946-86df-df0e34db484e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-f96a3315-7fdb-4f03-be71-fa3fb64921a2-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (b7eecab8-32c6-4d63-94b9-348871e9941a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5508808-92c5-46c3-8f1a-1e4641e5e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5508808-92c5-46c3-8f1a-1e4641e5e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554483363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7937fa19-15c3-4eef-8784-08d4b1bda605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:25Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06217e8-1ece-4b77-b1ac-9dab9537ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06217e8-1ece-4b77-b1ac-9dab9537ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e1a505-aec6-48a3-8241-0e9770b94a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e1a505-aec6-48a3-8241-0e9770b94a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7937fa19-15c3-4eef-8784-08d4b1bda605', 'volume_name': 'volume-7937fa19-15c3-4eef-8784-08d4b1bda605', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6d9dbb-bf52-40a1-b40c-6cf48171f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6d9dbb-bf52-40a1-b40c-6cf48171f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15347a5a-c4e9-428d-ad76-8cb0ebcb2daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Volume 7937fa19-15c3-4eef-8784-08d4b1bda605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7937fa19-15c3-4eef-8784-08d4b1bda605', 'volume_size': 1}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554483363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7937fa19-15c3-4eef-8784-08d4b1bda605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:25Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Creating volume 7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:25 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:15:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack sudo[109311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 1073741824
Nov 05 12:15:25 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:26 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 1073741824" returned: 0 in 0.586s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:26 devstack sudo[109318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605
Nov 05 12:15:26 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:26 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605" returned: 0 in 0.307s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15347a5a-c4e9-428d-ad76-8cb0ebcb2daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7937fa19-15c3-4eef-8784-08d4b1bda605', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9543a5-fb89-44b2-a282-55aa6d912dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Volume volume-7937fa19-15c3-4eef-8784-08d4b1bda605 (7937fa19-15c3-4eef-8784-08d4b1bda605): created successfully
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9543a5-fb89-44b2-a282-55aa6d912dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (b7eecab8-32c6-4d63-94b9-348871e9941a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6daf7cf3-5220-4d99-9581-b979727083d9 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:15:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot 21f28d44-ee29-418d-9672-d54953f05710 of volume 7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a80be-9bd1-4081-b8a8-a13bb6852851]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:27 devstack sudo[109321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605
Nov 05 12:15:27 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:28 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:28 devstack sudo[109326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 1G
Nov 05 12:15:28 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:28 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 1G" returned: 0 in 0.446s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7937fa19-15c3-4eef-8784-08d4b1bda605 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:28 devstack sudo[109335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7937fa19-15c3-4eef-8784-08d4b1bda605 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710
Nov 05 12:15:28 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:28 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7937fa19-15c3-4eef-8784-08d4b1bda605 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 is being set with open permissions: ugo+rw
Nov 05 12:15:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[109340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710
Nov 05 12:15:29 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:29 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[109343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.info
Nov 05 12:15:29 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:29 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.info" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:29 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.info is being set with open permissions: ugo+rw
Nov 05 12:15:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[109346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.info
Nov 05 12:15:29 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:29 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.info" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-972c13fc-27ca-493f-8a31-6cb02a63f357 tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:15:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-21f28d44-ee29-418d-9672-d54953f05710-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-21f28d44-ee29-418d-9672-d54953f05710-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-7937fa19-15c3-4eef-8784-08d4b1bda605" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-7937fa19-15c3-4eef-8784-08d4b1bda605" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-21f28d44-ee29-418d-9672-d54953f05710" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-21f28d44-ee29-418d-9672-d54953f05710" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot 21f28d44-ee29-418d-9672-d54953f05710 of volume 7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[146c1b90-7322-4993-92a6-38bb4ca9f519]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:31 devstack sudo[109349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710
Nov 05 12:15:31 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:31 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7937fa19-15c3-4eef-8784-08d4b1bda605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e29c99a-04e3-4dc2-8366-17a3e5eade3f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:31 devstack sudo[109354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605
Nov 05 12:15:31 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:32 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:32 devstack sudo[109359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710
Nov 05 12:15:32 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:32 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:32 devstack sudo[109365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710
Nov 05 12:15:32 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:32 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605.21f28d44-ee29-418d-9672-d54953f05710" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-21f28d44-ee29-418d-9672-d54953f05710" released by "_delete_snapshot" :: held 1.732s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-7937fa19-15c3-4eef-8784-08d4b1bda605" released by "delete_snapshot" :: held 1.758s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Created reservations ['6340af6c-1ce9-4c21-ba41-5d530dbd6d7a', 'e2a7b4d3-c593-4bd4-8697-8e012ccc5f90', '699ee983-ef03-4bd9-bbfa-3bc5fbbbf843', '452f6e67-9943-4a69-898e-b3363cc5e81a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:15:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d9c9516-1da5-49bd-8007-dba61b707468 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-21f28d44-ee29-418d-9672-d54953f05710-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-7937fa19-15c3-4eef-8784-08d4b1bda605-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Lock "cinder-7937fa19-15c3-4eef-8784-08d4b1bda605-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-7937fa19-15c3-4eef-8784-08d4b1bda605" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-7937fa19-15c3-4eef-8784-08d4b1bda605" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d674c99b-aafa-4db8-abc6-6eed0f9d3b97]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:33 devstack sudo[109368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605
Nov 05 12:15:33 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:33 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:33 devstack sudo[109373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605
Nov 05 12:15:33 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:34 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-7937fa19-15c3-4eef-8784-08d4b1bda605" returned: 0 in 0.305s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-7937fa19-15c3-4eef-8784-08d4b1bda605" released by "delete_volume" :: held 0.817s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Created reservations ['ef722cee-5c49-41b2-9492-f0d79d93dd34', '6b7a6fc5-2137-4ea3-add8-6a7aa08757aa', 'd5f7cbf4-1077-44c1-8db8-942f2cda9c56', 'e03bd26a-6f45-434d-bfcf-5e806d26dd01'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:34 devstack sudo[109377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:34 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:34 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bf1d6f43-a3b9-49d1-9678-b2bb456668cb tempest-ProjectMemberTests-1471482416 None] Lock "cinder-7937fa19-15c3-4eef-8784-08d4b1bda605-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (5a8784e7-d869-46be-a7ba-63fed3eb1ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a88ba07-5823-499d-baf1-858c19856804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a88ba07-5823-499d-baf1-858c19856804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436553136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c585aa-4651-4934-a241-6616c6165674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:35Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658e9d84-ce55-4b4f-b1cc-9c1d2216d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658e9d84-ce55-4b4f-b1cc-9c1d2216d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782b98fb-d0f3-4cf0-a978-7beac485fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782b98fb-d0f3-4cf0-a978-7beac485fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c585aa-4651-4934-a241-6616c6165674', 'volume_name': 'volume-d0c585aa-4651-4934-a241-6616c6165674', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b580c89-7eaa-44c1-9b0f-44d0885ee10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b580c89-7eaa-44c1-9b0f-44d0885ee10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eaa9eb-379f-419b-ab9f-9aeb285f63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Volume d0c585aa-4651-4934-a241-6616c6165674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c585aa-4651-4934-a241-6616c6165674', 'volume_size': 1}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436553136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c585aa-4651-4934-a241-6616c6165674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46bfa33be75413a803d106780908094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:35Z,use_quota=True,user_id='580330d3e7d44a7f90436ebdad537620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Creating volume d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:34 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:15:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:35 devstack sudo[109380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 1073741824
Nov 05 12:15:35 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:35 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 1073741824" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:35 devstack sudo[109386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674
Nov 05 12:15:35 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:35 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eaa9eb-379f-419b-ab9f-9aeb285f63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c585aa-4651-4934-a241-6616c6165674', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2421786-ca22-41fc-b717-6cf4a75ac777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Volume volume-d0c585aa-4651-4934-a241-6616c6165674 (d0c585aa-4651-4934-a241-6616c6165674): created successfully
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2421786-ca22-41fc-b717-6cf4a75ac777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Flow 'volume_create_manager' (5a8784e7-d869-46be-a7ba-63fed3eb1ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9da02e2c-edf5-44aa-8d9a-5eb0e829e2a1 tempest-ProjectMemberTests-1471482416 None] Created volume successfully.
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Creating offline snapshot ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 of volume d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7549b6a-d614-4a2d-8f58-908ad90aef06]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:37 devstack sudo[109389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674
Nov 05 12:15:37 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:37 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Flow 'volume_create_manager' (45d6bd2b-0157-40ed-83bc-be8991c1df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1c84af-eb30-4470-b776-7709cee4cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674" returned: 0 in 0.413s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:37 devstack sudo[109394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 1G
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1c84af-eb30-4470-b776-7709cee4cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-551565151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2175888d-19ec-424b-9b34-75e8605f432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c536ccdbf2e54545af86965f91d725d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:37Z,use_quota=True,user_id='89b371f80d2c472596a085fe64f8db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32531e06-f1be-4b90-b62c-e88539aa5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32531e06-f1be-4b90-b62c-e88539aa5074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d5c648-acf6-4130-a614-9c598a05e4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d5c648-acf6-4130-a614-9c598a05e4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2175888d-19ec-424b-9b34-75e8605f432e', 'volume_name': 'volume-2175888d-19ec-424b-9b34-75e8605f432e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdbd431-104c-449a-a255-4c8606795ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdbd431-104c-449a-a255-4c8606795ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2bd995-0af4-427c-875c-c48963dff4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Volume 2175888d-19ec-424b-9b34-75e8605f432e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2175888d-19ec-424b-9b34-75e8605f432e', 'volume_size': 1}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:37 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 1G" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c585aa-4651-4934-a241-6616c6165674 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[109400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c585aa-4651-4934-a241-6616c6165674 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29
Nov 05 12:15:38 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c585aa-4651-4934-a241-6616c6165674 -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 is being set with open permissions: ugo+rw
Nov 05 12:15:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[109405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29
Nov 05 12:15:38 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[109408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.info
Nov 05 12:15:38 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.info" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.info is being set with open permissions: ugo+rw
Nov 05 12:15:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[109411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.info
Nov 05 12:15:38 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:39 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.info" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7104550c3500>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-551565151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2175888d-19ec-424b-9b34-75e8605f432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c536ccdbf2e54545af86965f91d725d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:37Z,use_quota=True,user_id='89b371f80d2c472596a085fe64f8db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Creating volume 2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] casted to osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:39 devstack sudo[109414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e 1073741824
Nov 05 12:15:39 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2ef1f252-3212-4973-bcd3-fcf63076ac9e tempest-ProjectMemberTests-1471482416 None] Create snapshot completed successfully
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-d0c585aa-4651-4934-a241-6616c6165674" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-d0c585aa-4651-4934-a241-6616c6165674" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Deleting offline snapshot ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 of volume d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] snapshot_file for this snap is: volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28fc30b-7db7-4abe-b54b-c1b7f4c550c9]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:39 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e 1073741824" returned: 0 in 0.513s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:39 devstack sudo[109419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29
Nov 05 12:15:39 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:39 devstack sudo[109422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e
Nov 05 12:15:39 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:39 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0c585aa-4651-4934-a241-6616c6165674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a750a3d-91c1-4533-a5db-21831f94cb38]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:39 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2bd995-0af4-427c-875c-c48963dff4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2175888d-19ec-424b-9b34-75e8605f432e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae05c6d6-98ae-43d9-8ad1-7b84ae5f2c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Volume volume-2175888d-19ec-424b-9b34-75e8605f432e (2175888d-19ec-424b-9b34-75e8605f432e): created successfully
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae05c6d6-98ae-43d9-8ad1-7b84ae5f2c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Flow 'volume_create_manager' (45d6bd2b-0157-40ed-83bc-be8991c1df5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2748dc04-4e79-4501-b549-a42ec0689b4e tempest-SnapshotDependencyTests-1765845644 None] Created volume successfully.
Nov 05 12:15:40 devstack sudo[109428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674
Nov 05 12:15:40 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:40 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:40 devstack sudo[109433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29
Nov 05 12:15:40 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:40 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:40 devstack sudo[109438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29
Nov 05 12:15:40 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:40 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674.ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29" released by "_delete_snapshot" :: held 1.479s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-d0c585aa-4651-4934-a241-6616c6165674" released by "delete_snapshot" :: held 1.508s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Creating offline snapshot 01dd4b19-706f-432c-b920-49d0d92c7612 of volume 2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5154e8b-cba6-4e2b-8ebe-6462761128e2]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Created reservations ['af7fd19b-dc82-4825-bf80-87111368134e', '2718c390-3a25-4fc9-89cc-a844f74d1e63', '66e55d40-eb56-4fdd-862c-95b353fe6dc5', 'f621f1ec-a49a-439f-9167-fddee9083b1a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Delete snapshot completed successfully.
Nov 05 12:15:41 devstack sudo[109441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e
Nov 05 12:15:41 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d77c34c6-4da9-47f1-8d1a-4df2a2bcc94e tempest-ProjectMemberTests-1471482416 None] Lock "cinder-ab1e93f7-2f11-4d87-8b2c-3a4ef8c09a29-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:41 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e" returned: 0 in 0.368s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:41 devstack sudo[109446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 1G
Nov 05 12:15:41 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-d0c585aa-4651-4934-a241-6616c6165674-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-d0c585aa-4651-4934-a241-6616c6165674-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "cinder-quobyte-d0c585aa-4651-4934-a241-6616c6165674" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-d0c585aa-4651-4934-a241-6616c6165674" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983e66f-510a-4706-82c4-c8e82f924227]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:41 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 1G" returned: 0 in 0.461s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:41 devstack sudo[109451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674
Nov 05 12:15:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2175888d-19ec-424b-9b34-75e8605f432e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:41 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:41 devstack sudo[109453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2175888d-19ec-424b-9b34-75e8605f432e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612
Nov 05 12:15:41 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2175888d-19ec-424b-9b34-75e8605f432e -F qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack sudo[109461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674
Nov 05 12:15:42 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 is being set with open permissions: ugo+rw
Nov 05 12:15:42 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[109466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612
Nov 05 12:15:42 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-d0c585aa-4651-4934-a241-6616c6165674" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-quobyte-d0c585aa-4651-4934-a241-6616c6165674" released by "delete_volume" :: held 0.743s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[109473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.info
Nov 05 12:15:42 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Created reservations ['5eae5e0b-c6d4-4c32-ba80-da7295038cf7', '0b471658-65f9-448e-b9d6-2767642a8f40', '81fb125c-aac6-49c5-9c3c-8532bdbc1d76', '616a6de9-3f70-4899-b53f-12e42275278f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[109475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:42 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.info" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.info is being set with open permissions: ugo+rw
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[109478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.info
Nov 05 12:15:42 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Deleted volume successfully.
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-55d48a5a-e784-4cf0-9f1f-d443be843881 tempest-ProjectMemberTests-1471482416 None] Lock "cinder-d0c585aa-4651-4934-a241-6616c6165674-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:42 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.info" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-915e9033-8de9-4cee-bcfd-194617a398d7 tempest-SnapshotDependencyTests-1765845644 None] Create snapshot completed successfully
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Flow 'volume_create_manager' (1b528dd1-f258-47ed-a82e-6c3358ef90fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5357ba0-d338-4a1b-afb0-210aa0681e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5357ba0-d338-4a1b-afb0-210aa0681e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e82f89-4ce5-4304-ac2e-f15b19fc0b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c536ccdbf2e54545af86965f91d725d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01dd4b19-706f-432c-b920-49d0d92c7612,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:45Z,use_quota=True,user_id='89b371f80d2c472596a085fe64f8db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6255b8c-8e27-4782-910c-2f35ee7fefc5),volume_type_id=b6255b8c-8e27-4782-910c-2f35ee7fefc5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8854ccf-c111-4354-87d2-5c07d45ab407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8854ccf-c111-4354-87d2-5c07d45ab407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e2d063-abb9-4b93-a85c-f61fd32f51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e2d063-abb9-4b93-a85c-f61fd32f51aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95e82f89-4ce5-4304-ac2e-f15b19fc0b12', 'volume_name': 'volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12', 'volume_size': 1, 'snapshot_id': '01dd4b19-706f-432c-b920-49d0d92c7612'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55929a99-f8fd-4f3b-8f0c-ec14699cdd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55929a99-f8fd-4f3b-8f0c-ec14699cdd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89186fe3-a7d9-44bd-bbb1-42b941203802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Volume 95e82f89-4ce5-4304-ac2e-f15b19fc0b12: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12', 'volume_size': 1, 'snapshot_id': '01dd4b19-706f-432c-b920-49d0d92c7612'}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-quobyte-01dd4b19-706f-432c-b920-49d0d92c7612-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-01dd4b19-706f-432c-b920-49d0d92c7612-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Creating volume 95e82f89-4ce5-4304-ac2e-f15b19fc0b12 from snapshot 01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Selected osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-quobyte-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] snapshot: 01dd4b19-706f-432c-b920-49d0d92c7612, volume: 95e82f89-4ce5-4304-ac2e-f15b19fc0b12,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0bd7f-18f5-4a16-ad42-e631c562c363]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:44 devstack sudo[109483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612
Nov 05 12:15:44 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:45 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2175888d-19ec-424b-9b34-75e8605f432e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfcdf2f-e0b7-4d19-a5ee-edae4dc67c1f]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:45 devstack sudo[109488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:45 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack sudo[109490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e
Nov 05 12:15:45 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ba817e39-8ccd-45d8-b29a-19a5a801dd3c None None] thread info: [<_MainThread(MainThread, started 124263527014528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124263417742336)>, <Thread(Thread-3 (stat_writer), started daemon 124263413692032)>, <Thread(Rabbit-heartbeat, started daemon 124263412728896)>, <Thread(Thread-5 (_runner), started daemon 124263412812800)>, <Thread(Thread-7 (_runner), started daemon 124263410866624)>, <Thread(fd_logger, started daemon 124263409855360)>, <Thread(privsep_reader, started daemon 124263406544576)>, <Thread(tpool_thread_0, started daemon 124263402104512)>, <Thread(tpool_thread_1, started daemon 124263393711808)>, <Thread(tpool_thread_2, started daemon 124263385319104)>, <Thread(tpool_thread_3, started daemon 124263376926400)>, <Thread(tpool_thread_4, started daemon 124263368533696)>, <Thread(tpool_thread_5, started daemon 124263360140992)>, <Thread(tpool_thread_6, started daemon 124263351748288)>, <Thread(tpool_thread_7, started daemon 124263343355584)>, <Thread(tpool_thread_8, started daemon 124263334962880)>, <Thread(tpool_thread_9, started daemon 124263326570176)>, <Thread(tpool_thread_10, started daemon 124263318177472)>, <Thread(tpool_thread_11, started daemon 124263309768384)>, <Thread(tpool_thread_12, started daemon 124263301359296)>, <Thread(tpool_thread_13, started daemon 124263292950208)>, <Thread(tpool_thread_14, started daemon 124263284541120)>, <Thread(tpool_thread_15, started daemon 124263276132032)>, <Thread(tpool_thread_16, started daemon 124263267722944)>, <Thread(tpool_thread_17, started daemon 124263259313856)>, <Thread(tpool_thread_18, started daemon 124263250904768)>, <Thread(tpool_thread_19, started daemon 124263242495680)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:15:45 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Path /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:15:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:45 devstack sudo[109496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12
Nov 05 12:15:45 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:52 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" returned: 0 in 6.760s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Image conversion details: src /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:15:52 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Converted 1024.00 MB image at 151.46 MB/s
Nov 05 12:15:52 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 is being set with open permissions: ugo+rw
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:52 devstack sudo[109509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12
Nov 05 12:15:52 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:52 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" released by "_copy_volume_from_snapshot" :: held 7.921s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-01dd4b19-706f-432c-b920-49d0d92c7612-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" released by "_create_volume_from_snapshot" :: held 7.989s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89186fe3-a7d9-44bd-bbb1-42b941203802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12', 'volume_size': 1, 'snapshot_id': '01dd4b19-706f-432c-b920-49d0d92c7612'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff673b6c-ff7e-40ab-9e62-12d6735ae8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Volume volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 (95e82f89-4ce5-4304-ac2e-f15b19fc0b12): created successfully
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff673b6c-ff7e-40ab-9e62-12d6735ae8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Flow 'volume_create_manager' (1b528dd1-f258-47ed-a82e-6c3358ef90fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-97060e24-c747-43ae-9558-13f5789e5188 tempest-SnapshotDependencyTests-1765845644 None] Created volume successfully.
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-01dd4b19-706f-432c-b920-49d0d92c7612-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-01dd4b19-706f-432c-b920-49d0d92c7612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-quobyte-2175888d-19ec-424b-9b34-75e8605f432e" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-2175888d-19ec-424b-9b34-75e8605f432e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-quobyte-01dd4b19-706f-432c-b920-49d0d92c7612" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-01dd4b19-706f-432c-b920-49d0d92c7612" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Deleting offline snapshot 01dd4b19-706f-432c-b920-49d0d92c7612 of volume 2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] snapshot_file for this snap is: volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc5c3b-063c-41b4-af60-5606c68a341c]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:53 devstack sudo[109513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612
Nov 05 12:15:53 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:53 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2175888d-19ec-424b-9b34-75e8605f432e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8c69aa-5784-4810-af6a-53065c2a4b74]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:54 devstack sudo[109518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e
Nov 05 12:15:54 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:54 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e" returned: 0 in 0.591s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:54 devstack sudo[109524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612
Nov 05 12:15:54 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:54 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:55 devstack sudo[109529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612
Nov 05 12:15:55 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:55 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e.01dd4b19-706f-432c-b920-49d0d92c7612" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-01dd4b19-706f-432c-b920-49d0d92c7612" released by "_delete_snapshot" :: held 1.747s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-2175888d-19ec-424b-9b34-75e8605f432e" released by "delete_snapshot" :: held 1.777s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Created reservations ['7e50db79-9a4a-4d26-9cb5-8341947b2185', 'a3e8fa83-f3ca-45ef-ad41-da6f93f2c045', 'bd923986-dc8c-4726-8478-5d6d1f2c40e4', 'd789e8ec-0346-43b8-b702-ee2001406357'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Delete snapshot completed successfully.
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bdbe7fce-a098-4800-917f-bc46e5b926bc tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-01dd4b19-706f-432c-b920-49d0d92c7612-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-2175888d-19ec-424b-9b34-75e8605f432e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-2175888d-19ec-424b-9b34-75e8605f432e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-quobyte-2175888d-19ec-424b-9b34-75e8605f432e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-2175888d-19ec-424b-9b34-75e8605f432e" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4543b4-03da-4e0c-b79a-41726076c711]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:55 devstack sudo[109532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e
Nov 05 12:15:55 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:56 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:56 devstack sudo[109537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e
Nov 05 12:15:56 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:56 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-2175888d-19ec-424b-9b34-75e8605f432e" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-2175888d-19ec-424b-9b34-75e8605f432e" released by "delete_volume" :: held 0.715s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Created reservations ['fba92b6b-0401-4bdd-a2f4-43428bf34861', 'a365d345-b7ce-455c-8ce0-aeeb7c48760c', '1b654e61-aa71-4fd4-8bcc-b408c563dece', '2f23b956-3314-42d7-aa35-83675198a6e2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:56 devstack sudo[109540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:56 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:56 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Deleted volume successfully.
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-95e82f89-4ce5-4304-ac2e-f15b19fc0b12-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-95e82f89-4ce5-4304-ac2e-f15b19fc0b12-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-30e57963-86ba-4b29-94e5-98ad2f91f620 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-2175888d-19ec-424b-9b34-75e8605f432e-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "cinder-quobyte-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e652a0ba-5884-497a-9cac-947b6f2b45ab]: (4, 'qcow2') {{(pid=88859) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:57 devstack sudo[109543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12
Nov 05 12:15:57 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:57 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:57 devstack sudo[109548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12
Nov 05 12:15:57 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:57 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d/volume-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" returned: 0 in 0.252s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-quobyte-95e82f89-4ce5-4304-ac2e-f15b19fc0b12" released by "delete_volume" :: held 0.694s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Created reservations ['71368520-4504-464e-bf9f-d572aaff2750', 'bcccac7d-77b5-43e0-bef1-9a1ce539a5d7', '2799a718-cc4e-4338-8923-e4c8670e676b', 'ada72633-d496-46ab-85e8-2de1cdd06af7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4886a783-9773-46d7-b5ea-959dc2a9a9ce'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:57 devstack sudo[109551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d
Nov 05 12:15:57 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:58 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/200ccd0fa3f858646de7258bd00a1f7d" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:58 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Deleted volume successfully.
Nov 05 12:15:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-863400ba-73a5-4f24-8c1e-c3f5e8668318 tempest-SnapshotDependencyTests-1765845644 None] Lock "cinder-95e82f89-4ce5-4304-ac2e-f15b19fc0b12-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=80,cinder:SELECT=71,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:16:08 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=58,cinder:INSERT=24,cinder:UPDATE=81,cinder:DELETE=10 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}